Feb 24 10:54:15 devstack cinder-volume[72608]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 24 10:54:15 devstack cinder-volume[72608]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 24 10:54:15 devstack cinder-volume[72608]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 24 10:54:16 devstack cinder-volume[72608]: INFO dbcounter [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Registered counter for database cinder Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_db.sqlalchemy.engines [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG dbcounter [-] [72608] Writer thread running {{(pid=72608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 24 10:54:16 devstack cinder-volume[72608]: INFO cinder.rpc [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 24 10:54:16 devstack cinder-volume[72608]: INFO cinder.rpc [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_db.sqlalchemy.engines [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:54:16 devstack cinder-volume[72608]: INFO cinder.volume.manager [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Determined volume DB was empty at startup. Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG cinder.volume.manager [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72608) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 24 10:54:16 devstack cinder-volume[72608]: INFO cinder.volume.manager [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 24 10:54:16 devstack cinder-volume[72608]: WARNING stevedore.named [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 24 10:54:16 devstack cinder-volume[72608]: WARNING castellan.key_manager [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 24 10:54:16 devstack cinder-volume[72608]: WARNING cinder.keymgr.conf_key_mgr [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG cinder.volume.drivers.lvm [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72608) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_concurrency.processutils [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_concurrency.processutils [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] CMD "cinder-rtstool verify" returned: 0 in 0.228s {{(pid=72608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_db.sqlalchemy.engines [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:54:16 devstack cinder-volume[72608]: INFO cinder.rpc [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 24 10:54:16 devstack cinder-volume[72608]: INFO cinder.rpc [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 24 10:54:16 devstack cinder-volume[72608]: WARNING stevedore.named [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 24 10:54:16 devstack cinder-volume[72608]: WARNING castellan.key_manager [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 24 10:54:16 devstack cinder-volume[72608]: INFO cinder.volume.manager [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_db.sqlalchemy.engines [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:54:16 devstack cinder-volume[72608]: INFO oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Starting 1 workers Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Started child 72708 {{(pid=72608) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Full set of CONF: {{(pid=72608) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] ******************************************************************************** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Configuration options gathered from: {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] ================================================================================ {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] allow_availability_zone_fallback = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] allow_compression_on_image_upload = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] allowed_direct_url_schemes = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] api_rate_limit = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] auth_strategy = keystone {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] az_cache_duration = 3600 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_availability_zone = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_host = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_stats_polling_interval = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backup_api_class = cinder.backup.api.API {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backup_name_template = backup-%s {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backup_use_same_host = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backup_use_temp_snapshot = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] chap_password = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] chap_username = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_internal_tenant_project_id = 334e6079551544428e345ad2dc538e69 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_internal_tenant_user_id = 4b195c1735c14ae09137d5c71fb582f1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cloned_volume_same_az = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cluster = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] compression_format = gzip {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] compute_api_class = cinder.compute.nova.API {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] config_dir = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] config_source = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] control_exchange = openstack {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] debug = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] default_availability_zone = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] default_group_type = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] default_volume_type = lvmdriver-1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] disk_geometry = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] driver_client_cert = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] driver_client_cert_key = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] driver_data_namespace = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] driver_ssl_cert_path = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] driver_ssl_cert_verify = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] driver_use_ssl = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] enable_force_upload = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] enable_new_services = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] enable_unsupported_driver = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] enforce_multipath_for_image_xfer = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] filter_function = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_api_insecure = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_api_servers = ['http://192.168.122.137/image'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_api_ssl_compression = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_ca_certificates_file = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_catalog_info = image:glance:publicURL {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_certfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_keyfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_num_retries = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance_request_timeout = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] goodness_function = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] graceful_shutdown_timeout = 5 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] group_api_class = cinder.group.api.API {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] host = devstack {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_compress_on_upload = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_conversion_address_space_limit = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_conversion_cpu_limit = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72708]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_conversion_disable = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_upload_use_cinder_backend = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_upload_use_internal_tenant = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_volume_cache_enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_volume_cache_max_count = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] image_volume_cache_max_size_gb = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] init_host_max_objects_retrieval = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] instance_format = [instance: %(uuid)s] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] iscsi_target_flags = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] iscsi_write_cache = on {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] iser_helper = tgtadm {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] iser_ip_address = 192.168.122.137 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] iser_port = 3260 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_color = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_config_append = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_dir = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_file = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_options = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_rotate_interval = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_rotate_interval_type = days {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] log_rotation_type = none {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] max_age = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] max_logfile_count = 30 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] max_logfile_size_mb = 200 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] max_over_subscription_ratio = 20.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] message_reap_interval = 86400 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] message_ttl = 2592000 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] migration_create_volume_timeout_secs = 300 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] monkey_patch = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] monkey_patch_modules = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] my_ip = 192.168.122.137 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] no_snapshot_gb_quota = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] num_iser_scan_tries = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] num_shell_tries = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] num_volume_device_scan_tries = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] nvmeof_conn_info_version = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] nvmet_ns_id = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] nvmet_port_id = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] osapi_max_limit = 1000 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] osapi_volume_ext_list = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] osapi_volume_listen_port = 8776 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] osapi_volume_use_ssl = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] osapi_volume_workers = 2 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] per_volume_size_limit = -1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] periodic_fuzzy_delay = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] periodic_interval = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] public_endpoint = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] publish_errors = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] quota_backup_gigabytes = 1000 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] quota_backups = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] quota_gigabytes = 1000 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] quota_groups = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] quota_snapshots = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] quota_volumes = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] rate_limit_burst = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] rate_limit_except_level = CRITICAL {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] rate_limit_interval = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] reinit_driver_count = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] replication_device = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] report_discard_supported = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] report_interval = 120 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] reservation_clean_interval = 86400 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] reservation_expire = 86400 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] reserved_image_namespaces = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] reserved_percentage = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] rpc_response_timeout = 120 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] run_external_periodic_tasks = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] scst_target_driver = iscsi {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] scst_target_iqn_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_down_time = 720 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] shell_completion = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] snapshot_name_template = snapshot-%s {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] snapshot_same_host = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] split_loggers = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] state_path = /opt/stack/data/cinder {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] storage_availability_zone = nova {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] storage_protocol = iSCSI {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] syslog_log_facility = LOG_USER {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] target_helper = lioadm {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] target_ip_address = 192.168.122.137 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] target_port = 3260 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] target_protocol = iscsi {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] target_secondary_ip_addresses = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] trace_flags = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] transport_url = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] until_refresh = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] use_chap_auth = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] use_default_quota_class = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] use_journal = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] use_json = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] use_multipath_for_image_xfer = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] use_stderr = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] use_syslog = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] verify_glance_signatures = enabled {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_api_class = cinder.volume.api.API {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_backend_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_clear = zero {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_clear_ionice = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_clear_size = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_copy_bps_limit = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_dd_blocksize = 1M {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_name_template = volume-%s {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_service_inithost_offload = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volume_usage_audit_period = month {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] zoning_mode = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_concurrency.disable_process_locking = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.admin_password = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.admin_token = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.admin_user = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.auth_port = 35357 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.auth_protocol = https {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.auth_section = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.auth_type = password {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.auth_uri = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.auth_version = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.cache = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.certfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.identity_uri = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.include_service_catalog = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.insecure = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.interface = public {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.keyfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_password = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcache_username = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.region_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.service_type = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.137/identity {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.backend = dogpile.cache.null {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.backend_argument = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.backend_expiration_time = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.config_prefix = cache.oslo {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.debug_cache_backend = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.enable_retry_client = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.enable_socket_keepalive = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.enforce_fips_mode = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.expiration_time = 600 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.hashclient_retry_attempts = 2 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.memcache_dead_retry = 300 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.memcache_pool_maxsize = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.memcache_sasl_enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.password = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.proxies = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.redis_db = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.redis_server = localhost:6379 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.retry_attempts = 2 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.retry_delay = 0.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.socket_keepalive_count = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.socket_keepalive_idle = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.socket_keepalive_interval = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.socket_timeout = 1.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.tls_allowed_ciphers = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.tls_cafile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.tls_certfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.tls_enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.tls_keyfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cache.username = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] coordination.backend_url = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.asyncio_connection = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.asyncio_slave_connection = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.backend = sqlalchemy {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.connection = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.connection_debug = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.connection_parameters = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.connection_recycle_time = 3600 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.connection_trace = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.db_inc_retry_interval = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.db_max_retries = 20 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.db_max_retry_interval = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.db_retry_interval = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.max_overflow = 50 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.max_pool_size = 5 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.max_retries = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.mysql_wsrep_sync_wait = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.pool_timeout = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.retry_interval = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.slave_connection = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.sqlite_synchronous = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.synchronous_reader = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] database.use_db_reconnect = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.connection_string = messaging:// {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.es_doc_type = notification {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.es_scroll_size = 10000 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.es_scroll_time = 2m {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.filter_error_trace = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.hmac_keys = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.sentinel_service_name = mymaster {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.socket_timeout = 0.1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.trace_requests = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler.trace_sqlalchemy = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler_jaeger.process_tags = {} {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler_jaeger.service_name_prefix = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] profiler_otlp.service_name_prefix = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.enforce_new_defaults = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: WARNING oslo_config.cfg [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.enforce_scope = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.policy_default_rule = default {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.policy_file = policy.yaml {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] privsep_osbrick.group = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] privsep_osbrick.helper_command = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] privsep_osbrick.user = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_sys_admin.group = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_sys_admin.helper_command = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] cinder_sys_admin.user = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.auth_section = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.auth_type = password {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.cafile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.certfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.collect_timing = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.insecure = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.keyfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.send_service_user_token = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.split_loggers = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] service_user.timeout = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.auth_section = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.auth_type = password {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.certfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.collect_timing = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.insecure = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.keyfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.region_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.split_loggers = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] glance.timeout = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.backend_availability_zone = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.chap_password = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.chap_username = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.disk_geometry = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.driver_client_cert = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.driver_client_cert_key = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.driver_data_namespace = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.driver_use_ssl = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72708]: INFO cinder.volume.manager [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.extra_capabilities = {} {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.filter_function = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.goodness_function = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.iscsi_target_flags = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.iscsi_write_cache = on {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.iser_helper = tgtadm {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.iser_ip_address = 192.168.122.137 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.iser_port = 3260 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.lvm_share_target = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.lvm_type = auto {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.num_shell_tries = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.replication_device = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.report_discard_supported = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.reserved_percentage = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.target_helper = tgtadm {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.target_ip_address = 192.168.122.137 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.target_port = 3260 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.target_protocol = iscsi {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.trace_flags = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.unique_fqdn_network = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.use_chap_auth = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_backend_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_clear = zero {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_clear_ionice = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_clear_size = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_reports.file_event_handler = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_reports.log_dir = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.backend_host = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.chap_password = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.chap_username = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.disk_geometry = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.driver_client_cert = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.extra_capabilities = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.filter_function = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.goodness_function = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.iser_helper = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.iser_ip_address = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.iser_port = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.lvm_share_target = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.lvm_type = auto {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.num_shell_tries = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.replication_device = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.report_discard_supported = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.reserved_percentage = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.scst_target_driver = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.storage_protocol = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.target_helper = lioadm {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.target_ip_address = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.target_port = 3260 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.trace_flags = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.use_chap_auth = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_clear = zero {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_clear_size = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] lvmdriver-1.volumes_dir = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.ssl = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_notifications.driver = [] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_notifications.retry = -1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] key_manager.fixed_key = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.barbican_api_version = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.barbican_endpoint = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.barbican_endpoint_type = public {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.barbican_region_name = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.cafile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.certfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.collect_timing = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.insecure = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.keyfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.number_of_retries = 60 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.retry_delay = 1 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.send_service_user_token = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.split_loggers = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.timeout = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.verify_ssl = True {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican.verify_ssl_path = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.auth_section = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.auth_type = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.cafile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.certfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.collect_timing = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.insecure = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.keyfile = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.split_loggers = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] barbican_service_user.timeout = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.approle_role_id = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.approle_secret_id = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.kv_mountpoint = secret {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.kv_path = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.kv_version = 2 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.namespace = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.root_token_id = **** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.ssl_ca_crt_file = None {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.timeout = 60.0 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.use_ssl = False {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:54:16 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] ******************************************************************************** {{(pid=72608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 24 10:54:16 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:16 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:16 devstack sudo[72712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 24 10:54:16 devstack sudo[72712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:17 devstack sudo[72712]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:17 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:17 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:17 devstack sudo[72959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:17 devstack sudo[72959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:17 devstack sudo[72959]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:18 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.508s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:18 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 10:54:18 devstack cinder-volume[72708]: INFO cinder.brick.local_dev.lvm [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 24 10:54:18 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:18 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:18 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:18 devstack sudo[73162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:54:18 devstack sudo[73162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:18 devstack sudo[73162]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:18 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:18 devstack cinder-volume[72708]: DEBUG cinder.brick.local_dev.lvm [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72708) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 24 10:54:18 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:18 devstack sudo[73230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:18 devstack sudo[73230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:19 devstack sudo[73230]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:19 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.893s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:19 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:19 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:19 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:19 devstack sudo[73390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:19 devstack sudo[73390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:19 devstack sudo[73390]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:19 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:19 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:19 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:19 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:19 devstack sudo[73397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 24 10:54:19 devstack sudo[73397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:20 devstack sudo[73397]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:20 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.448s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:20 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:20 devstack sudo[73401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:54:20 devstack sudo[73401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:20 devstack sudo[73401]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:20 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:20 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:20 devstack sudo[73406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:54:20 devstack sudo[73406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:21 devstack sudo[73406]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:21 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:21 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:21 devstack sudo[73410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:54:21 devstack sudo[73410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:21 devstack sudo[73410]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:21 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:21 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:21 devstack sudo[73418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:21 devstack sudo[73418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:22 devstack sudo[73418]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:22 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:22 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:22 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:22 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:22 devstack sudo[73422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:22 devstack sudo[73422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:22 devstack sudo[73422]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:22 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:22 devstack cinder-volume[72708]: INFO cinder.volume.drivers.lvm [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 24 10:54:22 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:22 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:22 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:22 devstack sudo[73432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:22 devstack sudo[73432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:23 devstack sudo[73432]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:23 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.572s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:23 devstack cinder-volume[72708]: DEBUG cinder.volume.drivers.lvm [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Updating volume stats {{(pid=72708) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 24 10:54:23 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:23 devstack sudo[73545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:54:23 devstack sudo[73545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:23 devstack sudo[73545]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:23 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:23 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:23 devstack sudo[73616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:54:23 devstack sudo[73616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:24 devstack sudo[73616]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:24 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:24 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:24 devstack sudo[73689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:24 devstack sudo[73689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:24 devstack sudo[73689]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:24 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:24 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:24 devstack sudo[73692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:54:24 devstack sudo[73692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:25 devstack sudo[73692]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:25 devstack cinder-volume[72708]: INFO cinder.volume.driver [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Driver hasn't implemented _init_vendor_properties() Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG cinder.volume.driver [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72708) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG oslo_db.sqlalchemy.engines [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG dbcounter [-] [72708] Writer thread running {{(pid=72708) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG cinder.db.sqlalchemy.api [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Building query based on filter {{(pid=72708) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG cinder.image.image_utils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72708) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 24 10:54:25 devstack cinder-volume[72708]: INFO cinder.keymgr.migration [None req-3b42645b-28ea-4a94-90c8-c367a4883935 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG cinder.volume.drivers.lvm [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Updating volume stats {{(pid=72708) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:25 devstack sudo[73697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:54:25 devstack sudo[73697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:25 devstack sudo[73697]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:25 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:25 devstack sudo[73703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:54:25 devstack sudo[73703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:26 devstack sudo[73703]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:26 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:26 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:26 devstack sudo[73707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:26 devstack sudo[73707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:26 devstack sudo[73707]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:26 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:26 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:26 devstack sudo[73711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:54:26 devstack sudo[73711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:26 devstack cinder-volume[72608]: DEBUG dbcounter [-] [72608] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 10:54:27 devstack sudo[73711]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:27 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:27 devstack cinder-volume[72708]: DEBUG cinder.manager [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Notifying Schedulers of capabilities ... {{(pid=72708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:54:27 devstack cinder-volume[72708]: INFO cinder.volume.manager [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Driver initialization completed successfully. Feb 24 10:54:27 devstack cinder-volume[72708]: INFO cinder.manager [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Initiating service 2 cleanup Feb 24 10:54:27 devstack cinder-volume[72708]: INFO cinder.manager [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Service 2 cleanup completed. Feb 24 10:54:27 devstack cinder-volume[72708]: DEBUG cinder.service [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Creating RPC server for service cinder-volume {{(pid=72708) start /opt/stack/cinder/cinder/service.py:231}} Feb 24 10:54:27 devstack cinder-volume[72708]: DEBUG cinder.service [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72708) start /opt/stack/cinder/cinder/service.py:237}} Feb 24 10:54:27 devstack cinder-volume[72708]: INFO cinder.volume.manager [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 24 10:54:27 devstack cinder-volume[72708]: DEBUG cinder.volume.drivers.lvm [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Updating volume stats {{(pid=72708) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 24 10:54:27 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:27 devstack sudo[73717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:54:27 devstack sudo[73717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:27 devstack sudo[73717]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:27 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:27 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:27 devstack sudo[73724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:54:27 devstack sudo[73724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:28 devstack sudo[73724]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:28 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:28 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:28 devstack sudo[73781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:54:28 devstack sudo[73781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:28 devstack sudo[73781]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:28 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:28 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:54:28 devstack sudo[73784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:54:28 devstack sudo[73784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:54:29 devstack sudo[73784]: pam_unix(sudo:session): session closed for user root Feb 24 10:54:29 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:54:29 devstack cinder-volume[72708]: INFO cinder.volume.manager [None req-cdbde4f7-1313-47c8-abcf-6dcfd00dd468 None None] Driver post RPC initialization completed successfully. Feb 24 10:54:39 devstack cinder-volume[72708]: DEBUG dbcounter [-] [72708] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72708) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 10:54:39 devstack cinder-volume[72708]: DEBUG dbcounter [-] [72708] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72708) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 10:55:35 devstack cinder-volume[72708]: DEBUG oslo_service.periodic_task [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72708) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 10:55:35 devstack cinder-volume[72708]: DEBUG cinder.volume.drivers.lvm [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Updating volume stats {{(pid=72708) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 24 10:55:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:55:35 devstack sudo[78889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:55:35 devstack sudo[78889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:55:35 devstack sudo[78889]: pam_unix(sudo:session): session closed for user root Feb 24 10:55:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:55:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:55:35 devstack sudo[78897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:55:35 devstack sudo[78897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:55:36 devstack sudo[78897]: pam_unix(sudo:session): session closed for user root Feb 24 10:55:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:55:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:55:36 devstack sudo[78902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:55:36 devstack sudo[78902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:55:36 devstack sudo[78902]: pam_unix(sudo:session): session closed for user root Feb 24 10:55:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:55:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:55:36 devstack sudo[78905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:55:36 devstack sudo[78905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:55:36 devstack sudo[78905]: pam_unix(sudo:session): session closed for user root Feb 24 10:55:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:55:36 devstack cinder-volume[72708]: DEBUG cinder.manager [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Notifying Schedulers of capabilities ... {{(pid=72708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:56:35 devstack cinder-volume[72708]: DEBUG oslo_service.periodic_task [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72708) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 10:56:35 devstack cinder-volume[72708]: DEBUG cinder.volume.drivers.lvm [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Updating volume stats {{(pid=72708) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 24 10:56:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:56:35 devstack sudo[79555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:56:35 devstack sudo[79555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:56:35 devstack sudo[79555]: pam_unix(sudo:session): session closed for user root Feb 24 10:56:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:56:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:56:35 devstack sudo[79598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:56:35 devstack sudo[79598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:56:36 devstack sudo[79598]: pam_unix(sudo:session): session closed for user root Feb 24 10:56:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:56:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:56:36 devstack sudo[79806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:56:36 devstack sudo[79806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:56:36 devstack sudo[79806]: pam_unix(sudo:session): session closed for user root Feb 24 10:56:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:56:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:56:36 devstack sudo[79819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:56:36 devstack sudo[79819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:56:36 devstack sudo[79819]: pam_unix(sudo:session): session closed for user root Feb 24 10:56:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:56:36 devstack cinder-volume[72708]: DEBUG cinder.manager [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Notifying Schedulers of capabilities ... {{(pid=72708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:56:39 devstack cinder-volume[72708]: DEBUG dbcounter [-] [72708] Writing DB stats cinder:SELECT=1 {{(pid=72708) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 10:56:39 devstack cinder-volume[72708]: DEBUG dbcounter [-] [72708] Writing DB stats cinder:UPDATE=1 {{(pid=72708) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 10:57:35 devstack cinder-volume[72708]: DEBUG oslo_service.periodic_task [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72708) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 10:57:35 devstack cinder-volume[72708]: DEBUG cinder.volume.drivers.lvm [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Updating volume stats {{(pid=72708) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 24 10:57:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:57:35 devstack sudo[81406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 24 10:57:35 devstack sudo[81406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:57:35 devstack sudo[81406]: pam_unix(sudo:session): session closed for user root Feb 24 10:57:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.415s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:57:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:57:35 devstack sudo[81410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:57:35 devstack sudo[81410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:57:35 devstack sudo[81410]: pam_unix(sudo:session): session closed for user root Feb 24 10:57:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:57:35 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:57:35 devstack sudo[81415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 24 10:57:35 devstack sudo[81415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:57:36 devstack sudo[81415]: pam_unix(sudo:session): session closed for user root Feb 24 10:57:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:57:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:57:36 devstack sudo[81427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 24 10:57:36 devstack sudo[81427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:57:36 devstack sudo[81427]: pam_unix(sudo:session): session closed for user root Feb 24 10:57:36 devstack cinder-volume[72708]: DEBUG oslo_concurrency.processutils [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72708) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:57:36 devstack cinder-volume[72708]: DEBUG cinder.manager [None req-d8b0c730-6bb4-40b8-adce-09e1b228f5b8 None None] Notifying Schedulers of capabilities ... {{(pid=72708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:58:05 devstack cinder-volume[72608]: INFO oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Caught SIGTERM, stopping children Feb 24 10:58:05 devstack cinder-volume[72608]: DEBUG oslo_concurrency.lockutils [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Acquiring lock "singleton_lock" {{(pid=72608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 24 10:58:05 devstack cinder-volume[72608]: DEBUG oslo_concurrency.lockutils [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Acquired lock "singleton_lock" {{(pid=72608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 24 10:58:05 devstack cinder-volume[72608]: DEBUG oslo_concurrency.lockutils [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Releasing lock "singleton_lock" {{(pid=72608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 24 10:58:05 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Stop services. {{(pid=72608) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 24 10:58:05 devstack cinder-volume[72608]: DEBUG oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Killing children. {{(pid=72608) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 24 10:58:05 devstack cinder-volume[72608]: INFO oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Waiting on 1 children to exit Feb 24 10:58:07 devstack cinder-volume[72708]: DEBUG oslo_concurrency.lockutils [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Acquiring lock "singleton_lock" {{(pid=72708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 24 10:58:07 devstack cinder-volume[72708]: DEBUG oslo_concurrency.lockutils [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Acquired lock "singleton_lock" {{(pid=72708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 24 10:58:07 devstack cinder-volume[72708]: DEBUG oslo_concurrency.lockutils [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Releasing lock "singleton_lock" {{(pid=72708) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 24 10:58:07 devstack cinder-volume[72708]: WARNING amqp [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 24 10:58:07 devstack cinder-volume[72708]: WARNING amqp [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 24 10:58:07 devstack cinder-volume[72608]: INFO oslo_service.backend._eventlet.service [None req-3adf106f-02b4-4e11-911c-6ed2a6b98518 None None] Child 72708 exited with status 0 Feb 24 10:58:09 devstack cinder-volume[82155]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82155) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 24 10:58:09 devstack cinder-volume[82155]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82155) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 24 10:58:09 devstack cinder-volume[82155]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82155) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 24 10:58:10 devstack cinder-volume[82155]: INFO dbcounter [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Registered counter for database cinder Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_db.sqlalchemy.engines [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG dbcounter [-] [82155] Writer thread running {{(pid=82155) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 24 10:58:10 devstack cinder-volume[82155]: INFO cinder.rpc [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 24 10:58:10 devstack cinder-volume[82155]: INFO cinder.rpc [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_db.sqlalchemy.engines [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:58:10 devstack cinder-volume[82155]: INFO cinder.volume.manager [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Determined volume DB was empty at startup. Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG cinder.volume.manager [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82155) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 24 10:58:10 devstack cinder-volume[82155]: INFO cinder.volume.manager [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 24 10:58:10 devstack cinder-volume[82155]: WARNING stevedore.named [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 24 10:58:10 devstack cinder-volume[82155]: WARNING castellan.key_manager [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 24 10:58:10 devstack cinder-volume[82155]: WARNING cinder.keymgr.conf_key_mgr [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 24 10:58:10 devstack cinder-volume[82155]: INFO cinder.volume.manager [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_db.sqlalchemy.engines [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:58:10 devstack cinder-volume[82155]: INFO oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Starting 1 workers Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Started child 82275 {{(pid=82155) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Full set of CONF: {{(pid=82155) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] ******************************************************************************** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Configuration options gathered from: {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] ================================================================================ {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] allow_availability_zone_fallback = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] allow_compression_on_image_upload = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] allowed_direct_url_schemes = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82275]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] api_rate_limit = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] auth_strategy = keystone {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_availability_zone = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_host = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_stats_polling_interval = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backup_api_class = cinder.backup.api.API {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backup_name_template = backup-%s {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backup_use_same_host = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backup_use_temp_snapshot = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] chap_password = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] chap_username = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_internal_tenant_project_id = 334e6079551544428e345ad2dc538e69 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_internal_tenant_user_id = 4b195c1735c14ae09137d5c71fb582f1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cluster = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] compression_format = gzip {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] compute_api_class = cinder.compute.nova.API {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] config_dir = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] config_source = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] control_exchange = openstack {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] debug = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] default_availability_zone = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] default_group_type = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] default_volume_type = QuobyteHD {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] disk_geometry = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] driver_client_cert = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] driver_client_cert_key = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] driver_data_namespace = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] driver_ssl_cert_path = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] driver_ssl_cert_verify = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] driver_use_ssl = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] enable_new_services = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] enable_unsupported_driver = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] enabled_backends = ['QuobyteHD'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] enforce_multipath_for_image_xfer = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] filter_function = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_api_insecure = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_api_servers = ['http://192.168.122.137/image'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_api_ssl_compression = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_ca_certificates_file = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_catalog_info = image:glance:publicURL {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_certfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_keyfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_num_retries = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance_request_timeout = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] goodness_function = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] graceful_shutdown_timeout = 5 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] group_api_class = cinder.group.api.API {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] host = devstack {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_compress_on_upload = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_conversion_address_space_limit = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_conversion_cpu_limit = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_conversion_disable = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_upload_use_cinder_backend = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_upload_use_internal_tenant = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_volume_cache_enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_volume_cache_max_count = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] image_volume_cache_max_size_gb = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] init_host_max_objects_retrieval = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] instance_format = [instance: %(uuid)s] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] iscsi_target_flags = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] iscsi_write_cache = on {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] iser_helper = tgtadm {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] iser_ip_address = 192.168.122.137 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] iser_port = 3260 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_color = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_config_append = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_dir = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_file = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_options = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_rotate_interval = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_rotate_interval_type = days {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] log_rotation_type = none {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] max_age = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] max_logfile_count = 30 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] max_logfile_size_mb = 200 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] max_over_subscription_ratio = 20.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] message_reap_interval = 86400 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] message_ttl = 2592000 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] migration_create_volume_timeout_secs = 300 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] monkey_patch = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] monkey_patch_modules = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] my_ip = 192.168.122.137 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] no_snapshot_gb_quota = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] num_iser_scan_tries = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] num_shell_tries = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] num_volume_device_scan_tries = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] nvmeof_conn_info_version = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] nvmet_ns_id = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] nvmet_port_id = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] osapi_max_limit = 1000 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] osapi_volume_ext_list = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] osapi_volume_listen = 0.0.0.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] osapi_volume_listen_port = 8776 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] osapi_volume_use_ssl = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] osapi_volume_workers = 2 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] per_volume_size_limit = -1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] periodic_fuzzy_delay = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] periodic_interval = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] project_id_regex = [0-9a-f\-]+ {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] public_endpoint = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82275]: INFO cinder.volume.manager [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] publish_errors = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] quota_backup_gigabytes = 1000 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] quota_backups = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] quota_gigabytes = 1000 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] quota_groups = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] quota_snapshots = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] quota_volumes = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] rate_limit_burst = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] rate_limit_except_level = CRITICAL {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] rate_limit_interval = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] reinit_driver_count = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.remotefs [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82275) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] replication_device = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] report_discard_supported = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] report_interval = 120 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] reservation_clean_interval = 86400 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] reservation_expire = 86400 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] reserved_image_namespaces = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] reserved_percentage = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] rpc_response_timeout = 120 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] run_external_periodic_tasks = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] scst_target_driver = iscsi {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] scst_target_iqn_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_down_time = 720 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] shell_completion = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] snapshot_name_template = snapshot-%s {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] split_loggers = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] state_path = /opt/stack/data/cinder {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] storage_availability_zone = nova {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] storage_protocol = iSCSI {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] syslog_log_facility = LOG_USER {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] target_helper = lioadm {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] target_ip_address = 192.168.122.137 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] target_port = 3260 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] target_protocol = iscsi {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] target_secondary_ip_addresses = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] trace_flags = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] transfer_api_class = cinder.transfer.api.API {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] transport_url = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] until_refresh = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] use_chap_auth = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] use_default_quota_class = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] use_journal = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] use_json = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] use_multipath_for_image_xfer = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] use_stderr = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] use_syslog = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] verify_glance_signatures = enabled {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_api_class = cinder.volume.api.API {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_backend_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_clear = zero {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_clear_ionice = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_clear_size = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_copy_bps_limit = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_dd_blocksize = 1M {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_name_template = volume-%s {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_service_inithost_offload = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volume_usage_audit_period = month {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] zoning_mode = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_concurrency.disable_process_locking = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.admin_password = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.admin_token = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.admin_user = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.auth_admin_prefix = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.auth_port = 35357 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.auth_protocol = https {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.auth_section = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.auth_type = password {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.auth_uri = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.auth_version = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.cache = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.certfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.identity_uri = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.include_service_catalog = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.insecure = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.interface = public {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.keyfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_password = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcache_username = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.region_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.service_token_roles_required = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.service_type = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.137/identity {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.backend = dogpile.cache.null {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.backend_argument = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.backend_expiration_time = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.config_prefix = cache.oslo {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.debug_cache_backend = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.enable_retry_client = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.enable_socket_keepalive = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.enforce_fips_mode = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.expiration_time = 600 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.hashclient_retry_attempts = 2 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.memcache_dead_retry = 300 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.memcache_pool_maxsize = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.memcache_sasl_enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.password = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.proxies = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.redis_db = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.redis_server = localhost:6379 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.retry_attempts = 2 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.retry_delay = 0.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.socket_keepalive_count = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.socket_keepalive_idle = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.socket_keepalive_interval = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.socket_timeout = 1.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.tls_allowed_ciphers = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.tls_cafile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.tls_certfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.tls_enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.tls_keyfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cache.username = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] coordination.backend_url = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.asyncio_connection = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.asyncio_slave_connection = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.backend = sqlalchemy {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.connection = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.connection_debug = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.connection_parameters = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.connection_recycle_time = 3600 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.connection_trace = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.db_inc_retry_interval = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.db_max_retries = 20 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.db_max_retry_interval = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.db_retry_interval = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.max_overflow = 50 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.max_pool_size = 5 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.max_retries = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.mysql_wsrep_sync_wait = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.pool_timeout = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.retry_interval = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.slave_connection = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.sqlite_synchronous = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.synchronous_reader = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] database.use_db_reconnect = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.connection_string = messaging:// {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.es_doc_type = notification {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.es_scroll_size = 10000 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.es_scroll_time = 2m {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.filter_error_trace = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.hmac_keys = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.sentinel_service_name = mymaster {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.socket_timeout = 0.1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.trace_requests = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler.trace_sqlalchemy = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler_jaeger.process_tags = {} {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler_jaeger.service_name_prefix = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] profiler_otlp.service_name_prefix = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.enforce_new_defaults = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: WARNING oslo_config.cfg [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.enforce_scope = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.policy_default_rule = default {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.policy_file = policy.yaml {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_policy.remote_timeout = 60.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] privsep_osbrick.group = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] privsep_osbrick.helper_command = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] privsep_osbrick.user = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_sys_admin.group = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_sys_admin.helper_command = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] cinder_sys_admin.user = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.auth_section = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.auth_type = password {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82275) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.cafile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82275]: WARNING cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.certfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82275]: WARNING cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.collect_timing = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.insecure = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.keyfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.send_service_user_token = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.split_loggers = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] service_user.timeout = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Running cmd (subprocess): mount.quobyte {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.auth_section = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.auth_type = password {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.certfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.collect_timing = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.insecure = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.keyfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.region_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.split_loggers = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] glance.timeout = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.backend_availability_zone = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.chap_password = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.chap_username = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.disk_geometry = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.driver_client_cert = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.driver_client_cert_key = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.driver_data_namespace = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.driver_use_ssl = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.extra_capabilities = {} {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.filter_function = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.goodness_function = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.iscsi_target_flags = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.iscsi_write_cache = on {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.iser_helper = tgtadm {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.iser_ip_address = 192.168.122.137 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.iser_port = 3260 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_host = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_login = admin {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_mount_options = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_password = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_private_key = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_share_path = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_ssh_port = 22 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.num_shell_tries = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.quobyte_client_cfg = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.quobyte_volume_url = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.replication_device = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.report_discard_supported = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.reserved_percentage = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.target_helper = tgtadm {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.target_ip_address = 192.168.122.137 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.target_port = 3260 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.target_protocol = iscsi {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.trace_flags = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.unique_fqdn_network = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.use_chap_auth = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volume_backend_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volume_clear = zero {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volume_clear_ionice = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volume_clear_size = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_reports.file_event_handler = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_reports.log_dir = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.backend_availability_zone = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.backend_host = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.chap_password = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.chap_username = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.chiscsi_conf = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.disk_geometry = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.driver_client_cert = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.driver_client_cert_key = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.driver_data_namespace = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.driver_use_ssl = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.extra_capabilities = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.filter_function = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.goodness_function = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.iscsi_target_flags = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.iscsi_write_cache = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.iser_helper = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.iser_ip_address = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.iser_port = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.iser_target_prefix = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_host = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_login = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_mount_options = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_password = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_private_key = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_share_path = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_ssh_port = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.num_shell_tries = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nvmet_ns_id = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.nvmet_port_id = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.replication_device = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.report_discard_supported = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.reserved_percentage = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.scst_target_driver = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.storage_protocol = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack quobyte-client[82276]: Reading configuration file: /etc/quobyte/client.cfg Feb 24 10:58:10 devstack quobyte-client[82276]: Invalid parameters found, error: missing mount point. Feb 24 10:58:10 devstack quobyte-client[82276]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 24 10:58:10 devstack quobyte-client[82276]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.target_helper = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.target_ip_address = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.target_port = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.target_prefix = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.target_protocol = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.trace_flags = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.unique_fqdn_network = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.use_chap_auth = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volume_clear = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volume_clear_ionice = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volume_clear_size = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] QuobyteHD.volumes_dir = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:10 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:58:10 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:58:10 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:58:10 devstack cinder-volume[82275]: INFO cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 ... Feb 24 10:58:10 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 -c /etc/quobyte/client-cinder.cfg {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.ssl = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.ssl_version = {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_notifications.driver = [] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_notifications.retry = -1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] key_manager.fixed_key = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.barbican_api_version = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.barbican_endpoint = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.barbican_endpoint_type = public {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.barbican_region_name = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.cafile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.certfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.collect_timing = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.insecure = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.keyfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.number_of_retries = 60 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.retry_delay = 1 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.send_service_user_token = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.split_loggers = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.timeout = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.verify_ssl = True {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican.verify_ssl_path = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.auth_section = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.auth_type = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.cafile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.certfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.collect_timing = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.insecure = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.keyfile = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.split_loggers = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] barbican_service_user.timeout = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.approle_role_id = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.approle_secret_id = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.kv_mountpoint = secret {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.kv_path = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.kv_version = 2 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.namespace = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.root_token_id = **** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.ssl_ca_crt_file = None {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.timeout = 60.0 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.use_ssl = False {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:10 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] ******************************************************************************** {{(pid=82155) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 24 10:58:10 devstack sudo[82277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 -c /etc/quobyte/client-cinder.cfg Feb 24 10:58:10 devstack sudo[82277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:58:11 devstack sudo[82277]: pam_unix(sudo:session): session closed for user root Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.553s {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:11 devstack cinder-volume[82275]: INFO cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 succeeded Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.563s {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:11 devstack sudo[82346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:58:11 devstack sudo[82346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:58:11 devstack sudo[82346]: pam_unix(sudo:session): session closed for user root Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.405s {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:11 devstack cinder-volume[82275]: INFO cinder.volume.driver [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Driver hasn't implemented _init_vendor_properties() Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG cinder.volume.driver [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6931190490723, 'free_capacity_gb': 1775.6931190490723, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82275) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_db.sqlalchemy.engines [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82275) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG dbcounter [-] [82275] Writer thread running {{(pid=82275) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG cinder.db.sqlalchemy.api [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Building query based on filter {{(pid=82275) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG cinder.image.image_utils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82275) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 24 10:58:11 devstack cinder-volume[82275]: INFO cinder.keymgr.migration [None req-491e24dc-289c-4d5e-bac2-c6c74894daef None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:58:11 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:11 devstack sudo[82349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:58:11 devstack sudo[82349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:58:12 devstack sudo[82349]: pam_unix(sudo:session): session closed for user root Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.406s {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG cinder.manager [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Notifying Schedulers of capabilities ... {{(pid=82275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:58:12 devstack cinder-volume[82275]: INFO cinder.volume.manager [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Driver initialization completed successfully. Feb 24 10:58:12 devstack cinder-volume[82275]: INFO cinder.manager [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Initiating service 3 cleanup Feb 24 10:58:12 devstack cinder-volume[82275]: INFO cinder.manager [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Service 3 cleanup completed. Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG cinder.service [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Creating RPC server for service cinder-volume {{(pid=82275) start /opt/stack/cinder/cinder/service.py:231}} Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG cinder.service [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82275) start /opt/stack/cinder/cinder/service.py:237}} Feb 24 10:58:12 devstack cinder-volume[82275]: INFO cinder.volume.manager [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:58:12 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:12 devstack sudo[82355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:58:12 devstack sudo[82355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:58:13 devstack sudo[82355]: pam_unix(sudo:session): session closed for user root Feb 24 10:58:13 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.623s {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:13 devstack cinder-volume[82275]: INFO cinder.volume.manager [None req-26a939a0-3191-42f4-a52c-9931751f9285 None None] Driver post RPC initialization completed successfully. Feb 24 10:58:15 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:58:15 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:58:15 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:58:15 devstack cinder-volume[82275]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:58:15 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82275) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:58:15 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:15 devstack sudo[82445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:58:15 devstack sudo[82445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:58:15 devstack cinder-volume[82155]: INFO oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Caught SIGTERM, stopping children Feb 24 10:58:15 devstack cinder-volume[82155]: DEBUG oslo_concurrency.lockutils [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Acquiring lock "singleton_lock" {{(pid=82155) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 24 10:58:15 devstack cinder-volume[82155]: DEBUG oslo_concurrency.lockutils [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Acquired lock "singleton_lock" {{(pid=82155) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 24 10:58:15 devstack cinder-volume[82155]: DEBUG oslo_concurrency.lockutils [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Releasing lock "singleton_lock" {{(pid=82155) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 24 10:58:15 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Stop services. {{(pid=82155) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 24 10:58:15 devstack cinder-volume[82155]: DEBUG oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Killing children. {{(pid=82155) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 24 10:58:15 devstack cinder-volume[82155]: INFO oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Waiting on 1 children to exit Feb 24 10:58:16 devstack sudo[82445]: pam_unix(sudo:session): session closed for user root Feb 24 10:58:16 devstack cinder-volume[82275]: DEBUG oslo_concurrency.processutils [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.626s {{(pid=82275) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:16 devstack cinder-volume[82275]: DEBUG cinder.manager [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Notifying Schedulers of capabilities ... {{(pid=82275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Unable to connect to AMQP server on 192.168.122.137:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server [None req-ec9ec06d-61b5-4780-9953-9f0d8112e8e6 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.137:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 558, in _ensured Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 641, in __call__ Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server method() Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server self._producer.publish( Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return _publish( Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server listener(*args) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server raise error_for_code( Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.137:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Feb 24 10:58:16 devstack cinder-volume[82275]: ERROR oslo_messaging.rpc.server Feb 24 10:58:16 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Acquiring lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 24 10:58:16 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Acquired lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 24 10:58:16 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Releasing lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 24 10:58:16 devstack cinder-volume[82275]: WARNING amqp [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 24 10:58:16 devstack cinder-volume[82275]: WARNING amqp [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 24 10:58:16 devstack cinder-volume[82155]: INFO oslo_service.backend._eventlet.service [None req-eadb0df8-1648-4096-ae47-8d905c29207a None None] Child 82275 exited with status 0 Feb 24 10:58:18 devstack cinder-volume[82488]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82488) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 24 10:58:18 devstack cinder-volume[82488]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82488) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 24 10:58:18 devstack cinder-volume[82488]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82488) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 24 10:58:19 devstack cinder-volume[82488]: INFO dbcounter [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Registered counter for database cinder Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_db.sqlalchemy.engines [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writer thread running {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 24 10:58:19 devstack cinder-volume[82488]: INFO cinder.rpc [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 24 10:58:19 devstack cinder-volume[82488]: INFO cinder.rpc [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_db.sqlalchemy.engines [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:58:19 devstack cinder-volume[82488]: INFO cinder.volume.manager [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Determined volume DB was empty at startup. Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG cinder.volume.manager [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82488) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 24 10:58:19 devstack cinder-volume[82488]: WARNING stevedore.named [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 24 10:58:19 devstack cinder-volume[82488]: WARNING castellan.key_manager [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 24 10:58:19 devstack cinder-volume[82488]: WARNING cinder.keymgr.conf_key_mgr [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 24 10:58:19 devstack cinder-volume[82488]: INFO cinder.volume.manager [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_db.sqlalchemy.engines [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:58:19 devstack cinder-volume[82488]: INFO oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Starting 1 workers Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Started child 82627 {{(pid=82488) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Full set of CONF: {{(pid=82488) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] ******************************************************************************** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Configuration options gathered from: {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] ================================================================================ {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] allow_availability_zone_fallback = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] allow_compression_on_image_upload = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] allowed_direct_url_schemes = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] api_rate_limit = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] auth_strategy = keystone {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_availability_zone = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_host = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_stats_polling_interval = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backup_api_class = cinder.backup.api.API {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backup_name_template = backup-%s {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backup_use_same_host = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backup_use_temp_snapshot = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] chap_password = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] chap_username = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_internal_tenant_project_id = 334e6079551544428e345ad2dc538e69 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_internal_tenant_user_id = 4b195c1735c14ae09137d5c71fb582f1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cluster = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] compression_format = gzip {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] compute_api_class = cinder.compute.nova.API {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] config_dir = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] config_source = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82627]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] control_exchange = openstack {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] debug = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] default_availability_zone = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] default_group_type = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] default_volume_type = QuobyteHD {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] disk_geometry = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] driver_client_cert = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] driver_client_cert_key = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] driver_data_namespace = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] driver_ssl_cert_path = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] driver_ssl_cert_verify = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] driver_use_ssl = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] enable_new_services = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] enable_unsupported_driver = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] enabled_backends = ['QuobyteHD'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] enforce_multipath_for_image_xfer = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] filter_function = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_api_insecure = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_api_servers = ['http://192.168.122.137/image'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_api_ssl_compression = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_ca_certificates_file = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_catalog_info = image:glance:publicURL {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_certfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_keyfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_num_retries = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance_request_timeout = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] goodness_function = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] graceful_shutdown_timeout = 5 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] group_api_class = cinder.group.api.API {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] host = devstack {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_compress_on_upload = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_conversion_address_space_limit = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_conversion_cpu_limit = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_conversion_disable = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_upload_use_cinder_backend = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_upload_use_internal_tenant = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_volume_cache_enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_volume_cache_max_count = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] image_volume_cache_max_size_gb = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] init_host_max_objects_retrieval = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] instance_format = [instance: %(uuid)s] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] iscsi_target_flags = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] iscsi_write_cache = on {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] iser_helper = tgtadm {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] iser_ip_address = 192.168.122.137 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] iser_port = 3260 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_color = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_config_append = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_dir = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_file = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_options = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_rotate_interval = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_rotate_interval_type = days {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] log_rotation_type = none {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Starting volume driver QuobyteDriver (1.1.14) Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] max_age = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] max_logfile_count = 30 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] max_logfile_size_mb = 200 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] max_over_subscription_ratio = 20.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] message_reap_interval = 86400 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] message_ttl = 2592000 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] migration_create_volume_timeout_secs = 300 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] monkey_patch = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82627) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] monkey_patch_modules = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] my_ip = 192.168.122.137 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] no_snapshot_gb_quota = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] num_iser_scan_tries = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] num_shell_tries = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] num_volume_device_scan_tries = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] nvmeof_conn_info_version = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] nvmet_ns_id = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] nvmet_port_id = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] osapi_max_limit = 1000 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] osapi_volume_ext_list = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] osapi_volume_listen_port = 8776 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] osapi_volume_use_ssl = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] osapi_volume_workers = 2 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] per_volume_size_limit = -1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] periodic_fuzzy_delay = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] periodic_interval = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] public_endpoint = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] publish_errors = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] quota_backup_gigabytes = 1000 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] quota_backups = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] quota_gigabytes = 1000 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] quota_groups = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] quota_snapshots = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] quota_volumes = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] rate_limit_burst = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] rate_limit_except_level = CRITICAL {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] rate_limit_interval = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] reinit_driver_count = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] replication_device = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] report_discard_supported = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] report_interval = 120 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] reservation_clean_interval = 86400 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] reservation_expire = 86400 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] reserved_image_namespaces = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] reserved_percentage = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] rpc_response_timeout = 120 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] run_external_periodic_tasks = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] scst_target_driver = iscsi {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] scst_target_iqn_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_down_time = 720 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] shell_completion = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] snapshot_name_template = snapshot-%s {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] split_loggers = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] state_path = /opt/stack/data/cinder {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] storage_availability_zone = nova {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] storage_protocol = iSCSI {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] syslog_log_facility = LOG_USER {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] target_helper = lioadm {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] target_ip_address = 192.168.122.137 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] target_port = 3260 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] target_protocol = iscsi {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] target_secondary_ip_addresses = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] trace_flags = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] transport_url = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] until_refresh = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] use_chap_auth = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] use_default_quota_class = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] use_journal = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] use_json = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] use_multipath_for_image_xfer = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] use_stderr = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] use_syslog = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] verify_glance_signatures = enabled {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_api_class = cinder.volume.api.API {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_backend_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_clear = zero {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_clear_ionice = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_clear_size = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_copy_bps_limit = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_dd_blocksize = 1M {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_name_template = volume-%s {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_service_inithost_offload = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volume_usage_audit_period = month {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] zoning_mode = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_concurrency.disable_process_locking = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.admin_password = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.admin_token = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.admin_user = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.auth_port = 35357 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.auth_protocol = https {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.auth_section = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.auth_type = password {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.auth_uri = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.auth_version = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.cache = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.certfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.identity_uri = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.include_service_catalog = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.insecure = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.interface = public {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.keyfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_password = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcache_username = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.region_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.service_type = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.137/identity {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.backend = dogpile.cache.null {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.backend_argument = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.backend_expiration_time = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.config_prefix = cache.oslo {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.debug_cache_backend = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.enable_retry_client = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.enable_socket_keepalive = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.enforce_fips_mode = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.expiration_time = 600 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.hashclient_retry_attempts = 2 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.memcache_dead_retry = 300 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.memcache_pool_maxsize = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.memcache_sasl_enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.password = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.proxies = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.redis_db = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.redis_server = localhost:6379 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.retry_attempts = 2 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.retry_delay = 0.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.socket_keepalive_count = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.socket_keepalive_idle = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.socket_keepalive_interval = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.socket_timeout = 1.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.tls_allowed_ciphers = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.tls_cafile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.tls_certfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.tls_enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.tls_keyfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cache.username = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] coordination.backend_url = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.asyncio_connection = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.asyncio_slave_connection = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.backend = sqlalchemy {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.connection = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.connection_debug = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.connection_parameters = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.connection_recycle_time = 3600 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.connection_trace = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.db_inc_retry_interval = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.db_max_retries = 20 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.db_max_retry_interval = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.db_retry_interval = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.max_overflow = 50 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.max_pool_size = 5 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.max_retries = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.mysql_wsrep_sync_wait = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.pool_timeout = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.retry_interval = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.slave_connection = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.sqlite_synchronous = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.synchronous_reader = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] database.use_db_reconnect = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.connection_string = messaging:// {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.es_doc_type = notification {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.es_scroll_size = 10000 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.es_scroll_time = 2m {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.filter_error_trace = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.hmac_keys = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.sentinel_service_name = mymaster {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.socket_timeout = 0.1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.trace_requests = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82627) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 24 10:58:19 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 24 10:58:19 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler.trace_sqlalchemy = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler_jaeger.process_tags = {} {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler_jaeger.service_name_prefix = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] profiler_otlp.service_name_prefix = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.enforce_new_defaults = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Running cmd (subprocess): mount.quobyte {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:19 devstack cinder-volume[82488]: WARNING oslo_config.cfg [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.enforce_scope = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.policy_default_rule = default {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.policy_file = policy.yaml {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] privsep_osbrick.group = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] privsep_osbrick.helper_command = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] privsep_osbrick.user = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_sys_admin.group = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_sys_admin.helper_command = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] cinder_sys_admin.user = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.auth_section = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.auth_type = password {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.cafile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.certfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.collect_timing = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.insecure = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.keyfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.send_service_user_token = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.split_loggers = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] service_user.timeout = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.auth_section = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.auth_type = password {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.certfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.collect_timing = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.insecure = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.keyfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.region_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.split_loggers = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] glance.timeout = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.backend_availability_zone = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.chap_password = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.chap_username = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.disk_geometry = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.driver_client_cert = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.driver_client_cert_key = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.driver_data_namespace = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.driver_use_ssl = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.extra_capabilities = {} {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.filter_function = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.goodness_function = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.iscsi_target_flags = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.iscsi_write_cache = on {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.iser_helper = tgtadm {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.iser_ip_address = 192.168.122.137 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.iser_port = 3260 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_host = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_login = admin {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_mount_options = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_password = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_private_key = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_share_path = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.num_shell_tries = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.quobyte_volume_url = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.replication_device = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.report_discard_supported = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.reserved_percentage = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.target_helper = tgtadm {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack quobyte-client[82639]: Reading configuration file: /etc/quobyte/client.cfg Feb 24 10:58:19 devstack quobyte-client[82639]: Invalid parameters found, error: missing mount point. Feb 24 10:58:19 devstack quobyte-client[82639]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 24 10:58:19 devstack quobyte-client[82639]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.target_ip_address = 192.168.122.137 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.target_port = 3260 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.target_protocol = iscsi {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.trace_flags = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.unique_fqdn_network = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.use_chap_auth = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volume_backend_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volume_clear = zero {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volume_clear_ionice = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volume_clear_size = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_reports.file_event_handler = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_reports.log_dir = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.backend_availability_zone = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.backend_host = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.chap_password = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.chap_username = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.chiscsi_conf = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.disk_geometry = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.driver_client_cert = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.driver_data_namespace = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack sudo[82667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:58:19 devstack sudo[82667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.driver_use_ssl = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.extra_capabilities = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.filter_function = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.goodness_function = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.iser_helper = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.iser_ip_address = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.iser_port = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.iser_target_prefix = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_host = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_login = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_mount_options = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_password = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_private_key = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_share_path = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_ssh_port = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.num_shell_tries = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.nvmet_port_id = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.replication_device = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.report_discard_supported = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.reserved_percentage = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.scst_target_driver = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.storage_protocol = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.target_helper = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.target_ip_address = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.target_port = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.target_prefix = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.target_protocol = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.trace_flags = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.use_chap_auth = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volume_clear = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volume_clear_size = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] QuobyteHD.volumes_dir = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.ssl = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:19 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_notifications.driver = [] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_notifications.retry = -1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] key_manager.fixed_key = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.barbican_api_version = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.barbican_endpoint = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.barbican_endpoint_type = public {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.barbican_region_name = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.cafile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.certfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.collect_timing = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.insecure = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.keyfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.number_of_retries = 60 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.retry_delay = 1 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.send_service_user_token = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.split_loggers = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.timeout = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.verify_ssl = True {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican.verify_ssl_path = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.auth_section = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.auth_type = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.cafile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.certfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.collect_timing = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.insecure = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.keyfile = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.split_loggers = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] barbican_service_user.timeout = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.approle_role_id = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.approle_secret_id = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.kv_mountpoint = secret {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.kv_path = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.kv_version = 2 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.namespace = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.root_token_id = **** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.ssl_ca_crt_file = None {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.timeout = 60.0 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.use_ssl = False {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 24 10:58:20 devstack cinder-volume[82488]: DEBUG oslo_service.backend._eventlet.service [None req-92b424c3-8062-4f19-95c6-99f07c146740 None None] ******************************************************************************** {{(pid=82488) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 24 10:58:20 devstack sudo[82667]: pam_unix(sudo:session): session closed for user root Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.505s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:20 devstack cinder-volume[82627]: INFO cinder.volume.driver [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Driver hasn't implemented _init_vendor_properties() Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG cinder.volume.driver [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6931190490723, 'free_capacity_gb': 1775.6931190490723, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82627) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG oslo_db.sqlalchemy.engines [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82627) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writer thread running {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG cinder.db.sqlalchemy.api [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Building query based on filter {{(pid=82627) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82627) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:58:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:20 devstack cinder-volume[82627]: INFO cinder.keymgr.migration [None req-06132d78-31ff-401b-bc25-23ca146a7ca2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 24 10:58:20 devstack sudo[82708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:58:20 devstack sudo[82708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:58:21 devstack sudo[82708]: pam_unix(sudo:session): session closed for user root Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.003s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:58:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Driver initialization completed successfully. Feb 24 10:58:21 devstack cinder-volume[82627]: INFO cinder.manager [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Initiating service 3 cleanup Feb 24 10:58:21 devstack cinder-volume[82627]: INFO cinder.manager [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Service 3 cleanup completed. Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG cinder.service [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Creating RPC server for service cinder-volume {{(pid=82627) start /opt/stack/cinder/cinder/service.py:231}} Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG cinder.service [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82627) start /opt/stack/cinder/cinder/service.py:237}} Feb 24 10:58:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:58:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:58:21 devstack sudo[82745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:58:21 devstack sudo[82745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:58:22 devstack sudo[82745]: pam_unix(sudo:session): session closed for user root Feb 24 10:58:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.452s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:58:22 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-79d8de83-3931-49dc-b29c-dfd921b881dd None None] Driver post RPC initialization completed successfully. Feb 24 10:58:29 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 10:58:31 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=2 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 10:58:32 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Flow 'volume_create_manager' (e0338b9a-9483-4682-aab9-d2418fbe1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992745fc-2117-45d0-8c34-7e8947e9aa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992745fc-2117-45d0-8c34-7e8947e9aa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-937797276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2291b57d-564d-4757-b0b8-086ae0127924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292b19aa595542dea0876b81f0ebebd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:21Z,use_quota=True,user_id='3f5d6ea8a99c430f966a49bcc21f057b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc38e1ad-ee18-4622-b6c6-5fb78ba8619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc38e1ad-ee18-4622-b6c6-5fb78ba8619d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ef0149-a047-4912-a6fa-1b0194aa9673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ef0149-a047-4912-a6fa-1b0194aa9673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2291b57d-564d-4757-b0b8-086ae0127924', 'volume_name': 'volume-2291b57d-564d-4757-b0b8-086ae0127924', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4f6acf-bb02-4ea4-a908-bdda81cf321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4f6acf-bb02-4ea4-a908-bdda81cf321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6441fb09-d2bb-4be1-97b1-52a0a59eec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:21 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Volume 2291b57d-564d-4757-b0b8-086ae0127924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2291b57d-564d-4757-b0b8-086ae0127924', 'volume_size': 1} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-937797276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2291b57d-564d-4757-b0b8-086ae0127924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292b19aa595542dea0876b81f0ebebd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:21Z,use_quota=True,user_id='3f5d6ea8a99c430f966a49bcc21f057b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Creating volume 2291b57d-564d-4757-b0b8-086ae0127924 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 10:59:21 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 10:59:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:21 devstack sudo[83041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 1073741824 Feb 24 10:59:21 devstack sudo[83041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Flow 'volume_create_manager' (29c4af36-9fb5-4923-82e2-b5f72c035dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2547283-0b19-4823-955a-bbdab2394895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2547283-0b19-4823-955a-bbdab2394895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1532778473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc1cec5-e4c2-4084-a160-64509b1224f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2b0d4efcc74526b121fad35d7f216c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:22Z,use_quota=True,user_id='c4713a402cf34940b37f9d4366708d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9942df0f-d950-4d84-ba58-8af33e549293),volume_type_id=9942df0f-d950-4d84-ba58-8af33e549293)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bca38c2-d696-48ec-b097-1a2464e82c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bca38c2-d696-48ec-b097-1a2464e82c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b6c113-df51-4df9-8f5c-a16deafb0e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b6c113-df51-4df9-8f5c-a16deafb0e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc1cec5-e4c2-4084-a160-64509b1224f1', 'volume_name': 'volume-cbc1cec5-e4c2-4084-a160-64509b1224f1', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1ff897-f00d-46fb-89ed-943d0321c16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1ff897-f00d-46fb-89ed-943d0321c16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be8affd-9456-44a3-8f6a-3775e96e73a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:22 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Volume cbc1cec5-e4c2-4084-a160-64509b1224f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc1cec5-e4c2-4084-a160-64509b1224f1', 'volume_size': 1} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:22 devstack sudo[83041]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 1073741824" returned: 0 in 1.279s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:22 devstack sudo[83360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 Feb 24 10:59:22 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:23 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924" returned: 0 in 0.548s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1532778473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc1cec5-e4c2-4084-a160-64509b1224f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2b0d4efcc74526b121fad35d7f216c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:22Z,use_quota=True,user_id='c4713a402cf34940b37f9d4366708d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9942df0f-d950-4d84-ba58-8af33e549293),volume_type_id=9942df0f-d950-4d84-ba58-8af33e549293)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Creating volume cbc1cec5-e4c2-4084-a160-64509b1224f1 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 10:59:23 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6441fb09-d2bb-4be1-97b1-52a0a59eec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2291b57d-564d-4757-b0b8-086ae0127924', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79491322-13f7-4f37-9697-c11816f8cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:23 devstack sudo[83364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 1073741824 Feb 24 10:59:23 devstack sudo[83364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:23 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Volume volume-2291b57d-564d-4757-b0b8-086ae0127924 (2291b57d-564d-4757-b0b8-086ae0127924): created successfully Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79491322-13f7-4f37-9697-c11816f8cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Flow 'volume_create_manager' (e0338b9a-9483-4682-aab9-d2418fbe1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:23 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-949493d8-18ba-4240-8f13-84c4bd4b385c tempest-DeleteServersTestJSON-600691589 None] Created volume successfully. Feb 24 10:59:24 devstack sudo[83364]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 1073741824" returned: 0 in 0.980s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:24 devstack sudo[83369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 Feb 24 10:59:24 devstack sudo[83369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:24 devstack sudo[83369]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1" returned: 0 in 0.580s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be8affd-9456-44a3-8f6a-3775e96e73a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc1cec5-e4c2-4084-a160-64509b1224f1', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cc980a-682f-4f92-a680-fa43dc7d34cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:24 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Volume volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 (cbc1cec5-e4c2-4084-a160-64509b1224f1): created successfully Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cc980a-682f-4f92-a680-fa43dc7d34cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Flow 'volume_create_manager' (29c4af36-9fb5-4923-82e2-b5f72c035dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:24 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-451cb6c1-a385-42cf-8285-3e22f1ffba73 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Created volume successfully. Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Flow 'volume_create_manager' (31538e9e-7e5e-495f-aa56-2b5f561f7337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34b1eb6-d283-43cd-8e3b-234793d74aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34b1eb6-d283-43cd-8e3b-234793d74aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-139281825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290ac469-2b10-4f46-a698-85b6bf133f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514820ccd6484d1fa6999e40d16fe0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:25Z,use_quota=True,user_id='8e13b3a348544e43bedab02d8dc77339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3c5a98-f9ae-467e-aa4e-a8a4d006ea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3c5a98-f9ae-467e-aa4e-a8a4d006ea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4622b12-d71e-457a-8b14-6c2194bcdefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4622b12-d71e-457a-8b14-6c2194bcdefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290ac469-2b10-4f46-a698-85b6bf133f0f', 'volume_name': 'volume-290ac469-2b10-4f46-a698-85b6bf133f0f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a215337-f937-4ef4-ba2d-c74001928329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a215337-f937-4ef4-ba2d-c74001928329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e891ead-575d-42e7-bdfd-ec380f2ac71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:25 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Volume 290ac469-2b10-4f46-a698-85b6bf133f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290ac469-2b10-4f46-a698-85b6bf133f0f', 'volume_size': 1} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-139281825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290ac469-2b10-4f46-a698-85b6bf133f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514820ccd6484d1fa6999e40d16fe0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:25Z,use_quota=True,user_id='8e13b3a348544e43bedab02d8dc77339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Creating volume 290ac469-2b10-4f46-a698-85b6bf133f0f {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 10:59:25 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:25 devstack sudo[83374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f 1073741824 Feb 24 10:59:25 devstack sudo[83374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:25 devstack sudo[83374]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f 1073741824" returned: 0 in 0.642s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:25 devstack sudo[83380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f Feb 24 10:59:25 devstack sudo[83380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:26 devstack sudo[83385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:59:26 devstack sudo[83385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:26 devstack sudo[83380]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f" returned: 0 in 0.853s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e891ead-575d-42e7-bdfd-ec380f2ac71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290ac469-2b10-4f46-a698-85b6bf133f0f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0018693d-3b86-4895-98af-b9f17326687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:26 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Volume volume-290ac469-2b10-4f46-a698-85b6bf133f0f (290ac469-2b10-4f46-a698-85b6bf133f0f): created successfully Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0018693d-3b86-4895-98af-b9f17326687e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Flow 'volume_create_manager' (31538e9e-7e5e-495f-aa56-2b5f561f7337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:26 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3280ba20-54bd-41df-ae28-ce421fb5ac6b tempest-VolumesAdminNegativeTest-389294643 None] Created volume successfully. Feb 24 10:59:26 devstack sudo[83385]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.575s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:26 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:59:26 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-bcbee2e9-d42e-4d24-99fa-88160c836478 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Retype volume completed successfully. Feb 24 10:59:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Acquiring lock "cinder-290ac469-2b10-4f46-a698-85b6bf133f0f-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 10:59:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Lock "cinder-290ac469-2b10-4f46-a698-85b6bf133f0f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 10:59:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Acquiring lock "cinder-quobyte-290ac469-2b10-4f46-a698-85b6bf133f0f" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 10:59:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Lock "cinder-quobyte-290ac469-2b10-4f46-a698-85b6bf133f0f" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 10:59:27 devstack cinder-volume[82627]: INFO oslo.privsep.daemon [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5du6s2s8/privsep.sock'] Feb 24 10:59:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Acquiring lock "cinder-cbc1cec5-e4c2-4084-a160-64509b1224f1-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 10:59:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "cinder-cbc1cec5-e4c2-4084-a160-64509b1224f1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 10:59:27 devstack sudo[83405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5du6s2s8/privsep.sock Feb 24 10:59:27 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Acquiring lock "cinder-quobyte-cbc1cec5-e4c2-4084-a160-64509b1224f1" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 10:59:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "cinder-quobyte-cbc1cec5-e4c2-4084-a160-64509b1224f1" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 10:59:28 devstack cinder-volume[82627]: WARNING py.warnings [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 24 10:59:28 devstack cinder-volume[82627]: .first() Feb 24 10:59:28 devstack cinder-volume[82627]: Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:28 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:28 devstack cinder-volume[82627]: INFO oslo.privsep.daemon [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Spawned new privsep daemon via rootwrap Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Accepted privsep connection to /tmp/tmp5du6s2s8/privsep.sock {{(pid=82627) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 24 10:59:28 devstack cinder-volume[82627]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 24 10:59:28 devstack cinder-volume[82627]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 24 10:59:28 devstack cinder-volume[82627]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 24 10:59:28 devstack cinder-volume[82627]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83419 Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a47f7b-9d5b-4834-9493-31cd2b454ecc]: (2,) {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 10:59:28 devstack cinder-volume[82627]: WARNING oslo_privsep.priv_context [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] privsep daemon already running Feb 24 10:59:28 devstack cinder-volume[82627]: WARNING oslo_privsep.priv_context [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] privsep daemon already running Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7ca3ea-58ca-416a-be3e-ec7cbd6127c1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef38b56d-b9f9-4ce6-a1f1-cc7921c99833]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce04531d-7dda-4ea7-a5a4-6f57bf634ba2]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 10:59:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:29 devstack sudo[83427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 Feb 24 10:59:29 devstack sudo[83427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:29 devstack sudo[83425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f Feb 24 10:59:29 devstack sudo[83425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:29 devstack sudo[83426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 Feb 24 10:59:29 devstack sudo[83426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:29 devstack sudo[83425]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f" returned: 0 in 0.862s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:29 devstack sudo[83426]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1" returned: 0 in 0.878s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:29 devstack sudo[83440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f Feb 24 10:59:29 devstack sudo[83440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:29 devstack sudo[83442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1 Feb 24 10:59:29 devstack sudo[83442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:29 devstack sudo[83427]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924" returned: 0 in 0.942s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.040s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37', 'name': 'volume-2291b57d-564d-4757-b0b8-086ae0127924', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7af9d25d-2633-453e-9c70-13e93e387f1f', 'enforce_multipath': True} {{(pid=82627) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 24 10:59:30 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-5137327e-c5bb-4137-9e10-46b80d46aa24 req-f11cd045-e57e-4522-bb2a-b797be225dd6 tempest-DeleteServersTestJSON-600691589 None] attachment_update completed successfully. Feb 24 10:59:30 devstack sudo[83442]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cbc1cec5-e4c2-4084-a160-64509b1224f1" returned: 0 in 0.622s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "cinder-quobyte-cbc1cec5-e4c2-4084-a160-64509b1224f1" released by "delete_volume" :: held 2.650s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 10:59:30 devstack sudo[83440]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-290ac469-2b10-4f46-a698-85b6bf133f0f" returned: 0 in 0.691s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Lock "cinder-quobyte-290ac469-2b10-4f46-a698-85b6bf133f0f" released by "delete_volume" :: held 2.852s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 10:59:30 devstack cinder-volume[82627]: WARNING cinder.quota [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 24 10:59:30 devstack cinder-volume[82627]: WARNING cinder.quota [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Created reservations ['09b98fdc-fd1d-42fe-80de-fa3051bcc4c0', 'de83ad87-4605-4395-8e8c-ee16c6e741fa', '5d441b55-17b6-4386-9f21-03da365aa5b7', '830156ea-214a-4349-9da2-1d5fbfebe13b'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 10:59:30 devstack cinder-volume[82627]: WARNING cinder.quota [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 24 10:59:30 devstack cinder-volume[82627]: WARNING cinder.quota [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Created reservations ['0ab88e31-28e0-4361-8a79-594013f46335', '717135ab-23b6-49c9-acc2-174af2529267', 'd1dd1cc3-a070-4255-b695-0996da000558', 'e0af0ab8-6711-4fa9-89f6-913ad5dfb7a5'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 10:59:30 devstack sudo[83448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:59:30 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:30 devstack sudo[83495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:59:30 devstack sudo[83495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:32 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.355s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:32 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:59:32 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Deleted volume successfully. Feb 24 10:59:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-462ab39e-392c-4fbe-85b9-097e441621aa tempest-VolumesAdminNegativeTest-389294643 None] Lock "cinder-290ac469-2b10-4f46-a698-85b6bf133f0f-delete_volume" released by "delete_volume" :: held 4.530s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 10:59:32 devstack sudo[83495]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.652s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:32 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:59:32 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Deleted volume successfully. Feb 24 10:59:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5a7e80f1-83d9-45d9-a77b-8454500483e1 tempest-VolumeRetypeWithoutMigrationTest-489364589 None] Lock "cinder-cbc1cec5-e4c2-4084-a160-64509b1224f1-delete_volume" released by "delete_volume" :: held 4.767s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:34 devstack sudo[83878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:59:34 devstack sudo[83878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:34 devstack sudo[83878]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.623s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Flow 'volume_create_manager' (eddc3cb2-dac1-43c0-acbe-0d17ba0794ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529732fa-892b-4b2a-8034-2cbbc115c542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529732fa-892b-4b2a-8034-2cbbc115c542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1852967792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307d3bb2-f886-4e55-812b-18a21905b8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07e630bbdc349419fe5d80e6b2d3632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:37Z,use_quota=True,user_id='f1730ada5a984f34b412892f00cbd540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5534dc2b-58ca-4e8d-a3a4-4213a509c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5534dc2b-58ca-4e8d-a3a4-4213a509c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ab0b9d-3374-4035-ad96-48aa48c4f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ab0b9d-3374-4035-ad96-48aa48c4f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307d3bb2-f886-4e55-812b-18a21905b8e8', 'volume_name': 'volume-307d3bb2-f886-4e55-812b-18a21905b8e8', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9df862-a338-4df9-9e6d-80373876dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9df862-a338-4df9-9e6d-80373876dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac771a62-8c6c-4215-95a4-084a64bdbbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:37 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Volume 307d3bb2-f886-4e55-812b-18a21905b8e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307d3bb2-f886-4e55-812b-18a21905b8e8', 'volume_size': 1} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1852967792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307d3bb2-f886-4e55-812b-18a21905b8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07e630bbdc349419fe5d80e6b2d3632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:37Z,use_quota=True,user_id='f1730ada5a984f34b412892f00cbd540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Creating volume 307d3bb2-f886-4e55-812b-18a21905b8e8 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 10:59:37 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 10:59:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:37 devstack sudo[83915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 1073741824 Feb 24 10:59:37 devstack sudo[83915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:38 devstack sudo[83915]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 1073741824" returned: 0 in 0.926s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:38 devstack sudo[83965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 Feb 24 10:59:38 devstack sudo[83965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:38 devstack sudo[83965]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8" returned: 0 in 0.454s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac771a62-8c6c-4215-95a4-084a64bdbbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307d3bb2-f886-4e55-812b-18a21905b8e8', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701fe1f7-f087-4146-bc25-9ca17b6fb3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:38 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Volume volume-307d3bb2-f886-4e55-812b-18a21905b8e8 (307d3bb2-f886-4e55-812b-18a21905b8e8): created successfully Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701fe1f7-f087-4146-bc25-9ca17b6fb3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Flow 'volume_create_manager' (eddc3cb2-dac1-43c0-acbe-0d17ba0794ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:38 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-fad76660-4e55-48fe-9204-003cc8eccf44 tempest-VolumesServicesTestJSON-86831561 None] Created volume successfully. Feb 24 10:59:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Acquiring lock "cinder-307d3bb2-f886-4e55-812b-18a21905b8e8-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 10:59:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Lock "cinder-307d3bb2-f886-4e55-812b-18a21905b8e8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 10:59:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Acquiring lock "cinder-quobyte-307d3bb2-f886-4e55-812b-18a21905b8e8" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 10:59:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Lock "cinder-quobyte-307d3bb2-f886-4e55-812b-18a21905b8e8" acquired by "delete_volume" :: waited 0.006s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 10:59:39 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2537ec-84b1-4cda-9fc9-dab7a9304cae]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 10:59:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:39 devstack sudo[83971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 Feb 24 10:59:39 devstack sudo[83971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:39 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-255f0c09-d895-4168-bcf2-8f83adf4fb1b req-f673dca5-3a3c-4960-b7f0-84168ea0dfc8 tempest-DeleteServersTestJSON-600691589 None] Terminate volume connection completed successfully. Feb 24 10:59:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-255f0c09-d895-4168-bcf2-8f83adf4fb1b req-f673dca5-3a3c-4960-b7f0-84168ea0dfc8 tempest-DeleteServersTestJSON-600691589 None] Deleting attachment 7af9d25d-2633-453e-9c70-13e93e387f1f. {{(pid=82627) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 24 10:59:40 devstack sudo[83971]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8" returned: 0 in 0.765s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:40 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8 Feb 24 10:59:40 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:40 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-307d3bb2-f886-4e55-812b-18a21905b8e8" returned: 0 in 0.485s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Lock "cinder-quobyte-307d3bb2-f886-4e55-812b-18a21905b8e8" released by "delete_volume" :: held 1.282s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Created reservations ['70cf63e9-27ce-437e-8787-730f07eb8fdd', 'fca1b864-af67-47e1-ba50-42c0d69b03d7', '0e1850ec-81c7-4bb9-af04-12200185ffe3', '3400af9c-0a17-4e1c-91bf-24022a5eff5a'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:40 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:59:40 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:41 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.490s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:41 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:59:41 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Deleted volume successfully. Feb 24 10:59:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b44c8d49-99e8-4277-9e7d-b84eabcf904a tempest-VolumesServicesTestJSON-86831561 None] Lock "cinder-307d3bb2-f886-4e55-812b-18a21905b8e8-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 10:59:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Acquiring lock "cinder-2291b57d-564d-4757-b0b8-086ae0127924-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 10:59:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Lock "cinder-2291b57d-564d-4757-b0b8-086ae0127924-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 10:59:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Acquiring lock "cinder-quobyte-2291b57d-564d-4757-b0b8-086ae0127924" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 10:59:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Lock "cinder-quobyte-2291b57d-564d-4757-b0b8-086ae0127924" acquired by "delete_volume" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 10:59:43 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa4048b-0ed2-441d-b50f-be82c2b4b836]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 10:59:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:44 devstack sudo[83991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 Feb 24 10:59:44 devstack sudo[83991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:44 devstack sudo[83991]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924" returned: 0 in 0.672s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:44 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924 Feb 24 10:59:44 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:45 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2291b57d-564d-4757-b0b8-086ae0127924" returned: 0 in 0.530s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Lock "cinder-quobyte-2291b57d-564d-4757-b0b8-086ae0127924" released by "delete_volume" :: held 1.227s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Created reservations ['3d79b4cb-d4d1-408d-8392-bde31f2a7a52', '9456e0f6-f026-4f3c-b8e0-cdd764569940', 'b97721f3-ca8a-47ec-a613-c7af48cbb617', '3e4cc82c-5270-4b0f-ac03-c1de72878436'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:45 devstack sudo[83999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 10:59:45 devstack sudo[83999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:46 devstack sudo[83999]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.805s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:46 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 10:59:46 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Deleted volume successfully. Feb 24 10:59:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d777e1fa-9a8f-4e96-85a6-e0d06d3eb829 tempest-DeleteServersTestJSON-600691589 None] Lock "cinder-2291b57d-564d-4757-b0b8-086ae0127924-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Flow 'volume_create_manager' (dce0ccb1-8cd0-41fa-a683-b3aaf10bc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a1355a-0f60-43d8-9498-abe37c540334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a1355a-0f60-43d8-9498-abe37c540334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1350337130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d11d69-04df-459d-82f3-b2948edbb7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3147e7d8e4520845afe5dc5a11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:54Z,use_quota=True,user_id='3da0e70518f94cacbac14307d1cc5f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f30926-7b40-449a-af6b-e46b5288800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f30926-7b40-449a-af6b-e46b5288800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df86b7da-0c8b-4742-b4dd-6fc0d81c4c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df86b7da-0c8b-4742-b4dd-6fc0d81c4c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d11d69-04df-459d-82f3-b2948edbb7a7', 'volume_name': 'volume-f1d11d69-04df-459d-82f3-b2948edbb7a7', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740d8ec3-2d9b-4fe7-b82e-6e75bcf53060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740d8ec3-2d9b-4fe7-b82e-6e75bcf53060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e87249-e483-4476-a710-233669fa8fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:54 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Volume f1d11d69-04df-459d-82f3-b2948edbb7a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d11d69-04df-459d-82f3-b2948edbb7a7', 'volume_size': 1} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1350337130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d11d69-04df-459d-82f3-b2948edbb7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3147e7d8e4520845afe5dc5a11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:54Z,use_quota=True,user_id='3da0e70518f94cacbac14307d1cc5f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Creating volume f1d11d69-04df-459d-82f3-b2948edbb7a7 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 10:59:54 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 10:59:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:54 devstack sudo[84068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 1073741824 Feb 24 10:59:54 devstack sudo[84068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Flow 'volume_create_manager' (e84f91b3-d953-4f1b-abbc-812fd51a3f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28afdd8c-ef30-4b51-af3d-7ecb4b70effd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28afdd8c-ef30-4b51-af3d-7ecb4b70effd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1503898353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1de0f2-9cb5-4162-b1eb-91935304ee4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5710ea6ff9234863b79468c1282b4b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:55Z,use_quota=True,user_id='716627f58b94454f8f9b9bff68fa1704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91e5e00-6f99-433b-8e1f-a8f3c045fcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91e5e00-6f99-433b-8e1f-a8f3c045fcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9754824f-c442-4800-bce7-c4a3687e9147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9754824f-c442-4800-bce7-c4a3687e9147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1de0f2-9cb5-4162-b1eb-91935304ee4d', 'volume_name': 'volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93895360-2e87-409e-8b59-afe2667f03d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93895360-2e87-409e-8b59-afe2667f03d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb57c7f-b1b3-4cc5-914f-ff1862a9f91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:55 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Volume fa1de0f2-9cb5-4162-b1eb-91935304ee4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d', 'volume_size': 1} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:55 devstack sudo[84068]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 1073741824" returned: 0 in 1.436s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:55 devstack sudo[84100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 Feb 24 10:59:55 devstack sudo[84100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:56 devstack sudo[84100]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7" returned: 0 in 0.835s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] <== create_volume: return (2304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.306s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1503898353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1de0f2-9cb5-4162-b1eb-91935304ee4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5710ea6ff9234863b79468c1282b4b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:55Z,use_quota=True,user_id='716627f58b94454f8f9b9bff68fa1704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Creating volume fa1de0f2-9cb5-4162-b1eb-91935304ee4d {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 10:59:56 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e87249-e483-4476-a710-233669fa8fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d11d69-04df-459d-82f3-b2948edbb7a7', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f723e-d4ab-4d76-9aff-61cb7d1fce88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:56 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Volume volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 (f1d11d69-04df-459d-82f3-b2948edbb7a7): created successfully Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f723e-d4ab-4d76-9aff-61cb7d1fce88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Flow 'volume_create_manager' (dce0ccb1-8cd0-41fa-a683-b3aaf10bc2db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:56 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d 1073741824 Feb 24 10:59:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6dc98526-183f-44b6-aa09-8d37dc7aa5a7 tempest-VolumesListAdminTestJSON-1002853530 None] Created volume successfully. Feb 24 10:59:56 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:57 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d 1073741824" returned: 0 in 0.671s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:57 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d Feb 24 10:59:57 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:58 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" returned: 0 in 0.909s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Flow 'volume_create_manager' (a2099f5a-4587-4654-aad6-eac1d3d906f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa4e51e-5e3e-41e1-ac23-269c933df090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa4e51e-5e3e-41e1-ac23-269c933df090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1881837717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a55912-a7d8-4e96-a29c-35d7553b327a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3147e7d8e4520845afe5dc5a11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:58Z,use_quota=True,user_id='3da0e70518f94cacbac14307d1cc5f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53ea155-a89b-4491-94e3-07e44d2feab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53ea155-a89b-4491-94e3-07e44d2feab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5c5db0-5bd4-49d9-b4f9-42155c086ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5c5db0-5bd4-49d9-b4f9-42155c086ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a55912-a7d8-4e96-a29c-35d7553b327a', 'volume_name': 'volume-b7a55912-a7d8-4e96-a29c-35d7553b327a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65a38fb-8e65-4a00-9e8f-16ee3d688e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65a38fb-8e65-4a00-9e8f-16ee3d688e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3820d82-3718-4bd0-968d-d5815a861861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:58 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Volume b7a55912-a7d8-4e96-a29c-35d7553b327a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a55912-a7d8-4e96-a29c-35d7553b327a', 'volume_size': 1} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T09:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1881837717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a55912-a7d8-4e96-a29c-35d7553b327a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3147e7d8e4520845afe5dc5a11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T09:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T09:59:58Z,use_quota=True,user_id='3da0e70518f94cacbac14307d1cc5f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Creating volume b7a55912-a7d8-4e96-a29c-35d7553b327a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 10:59:58 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb57c7f-b1b3-4cc5-914f-ff1862a9f91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ce5e0e-72da-4ae8-8451-8d0cf6d9dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:58 devstack sudo[84116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a 1073741824 Feb 24 10:59:58 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:58 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Volume volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d (fa1de0f2-9cb5-4162-b1eb-91935304ee4d): created successfully Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ce5e0e-72da-4ae8-8451-8d0cf6d9dd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Flow 'volume_create_manager' (e84f91b3-d953-4f1b-abbc-812fd51a3f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 10:59:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-94eac0ac-b3dc-4e7c-8fef-64e135d2806a req-73a142ca-cae5-4a8a-a33e-4ec9e9aed247 tempest-VolumesSnapshotsTestJSON-1632427690 None] Created volume successfully. Feb 24 10:59:59 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a 1073741824" returned: 0 in 0.989s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:59 devstack sudo[84125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a Feb 24 10:59:59 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 10:59:59 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a" returned: 0 in 0.629s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.515s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Creating offline snapshot 56bfa801-4079-464e-bce7-34ff0aec537d of volume fa1de0f2-9cb5-4162-b1eb-91935304ee4d {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3820d82-3718-4bd0-968d-d5815a861861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a55912-a7d8-4e96-a29c-35d7553b327a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6e4123-ec2f-4dba-adc8-acda28a7f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eb7450-778d-407f-8006-63afdeaff60d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 10:59:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Volume volume-b7a55912-a7d8-4e96-a29c-35d7553b327a (b7a55912-a7d8-4e96-a29c-35d7553b327a): created successfully Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6e4123-ec2f-4dba-adc8-acda28a7f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 10:59:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Flow 'volume_create_manager' (a2099f5a-4587-4654-aad6-eac1d3d906f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ff3b75c8-c0a8-4874-9881-330a4cfc8b2a tempest-VolumesListAdminTestJSON-1002853530 None] Created volume successfully. Feb 24 11:00:00 devstack sudo[84156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d Feb 24 11:00:00 devstack sudo[84156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:00 devstack sudo[84156]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" returned: 0 in 0.618s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:00 devstack sudo[84162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d 1G Feb 24 11:00:00 devstack sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Flow 'volume_create_manager' (9d273c3c-f947-4aaa-ace3-1019c29afaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97f8ece-6173-4d4d-9b2c-a8f9b7fccd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97f8ece-6173-4d4d-9b2c-a8f9b7fccd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1642983063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d20204-356a-44df-af17-2b5d789a21d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3147e7d8e4520845afe5dc5a11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:01Z,use_quota=True,user_id='3da0e70518f94cacbac14307d1cc5f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2f6a49-66b4-4950-be67-c48aa3341ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2f6a49-66b4-4950-be67-c48aa3341ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f544c03-8ca3-4170-a6b2-c5a9c998bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f544c03-8ca3-4170-a6b2-c5a9c998bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d20204-356a-44df-af17-2b5d789a21d7', 'volume_name': 'volume-80d20204-356a-44df-af17-2b5d789a21d7', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe302170-464d-44e3-b2e7-d550c532e582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe302170-464d-44e3-b2e7-d550c532e582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b7987b-5b2d-422b-b321-b1d7ebc7c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:01 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Volume 80d20204-356a-44df-af17-2b5d789a21d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d20204-356a-44df-af17-2b5d789a21d7', 'volume_size': 1} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:01 devstack sudo[84162]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d 1G" returned: 0 in 0.844s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:01 devstack sudo[84167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d Feb 24 11:00:01 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:02 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d" returned: 0 in 0.614s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:02 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d is being set with open permissions: ugo+rw Feb 24 11:00:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:02 devstack sudo[84173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d Feb 24 11:00:02 devstack sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:02 devstack sudo[84173]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d" returned: 0 in 0.451s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:02 devstack sudo[84176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.info Feb 24 11:00:02 devstack sudo[84176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:03 devstack sudo[84176]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.info" returned: 0 in 0.645s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:03 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.info is being set with open permissions: ugo+rw Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:03 devstack sudo[84179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.info Feb 24 11:00:03 devstack sudo[84179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:03 devstack sudo[84179]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.info" returned: 0 in 0.588s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.828s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.584s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1642983063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d20204-356a-44df-af17-2b5d789a21d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3147e7d8e4520845afe5dc5a11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:01Z,use_quota=True,user_id='3da0e70518f94cacbac14307d1cc5f66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Creating volume 80d20204-356a-44df-af17-2b5d789a21d7 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:03 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:03 devstack sudo[84182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 1073741824 Feb 24 11:00:03 devstack sudo[84182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:03 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-541916e6-a0bc-474f-9b4e-f23fb3d77310 req-4dbf4ada-68e5-4645-b779-c4ce6f10a016 tempest-VolumesSnapshotsTestJSON-1632427690 None] Create snapshot completed successfully Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "cinder-56bfa801-4079-464e-bce7-34ff0aec537d-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-56bfa801-4079-464e-bce7-34ff0aec537d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "cinder-quobyte-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-quobyte-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "cinder-quobyte-56bfa801-4079-464e-bce7-34ff0aec537d" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-quobyte-56bfa801-4079-464e-bce7-34ff0aec537d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Deleting offline snapshot 56bfa801-4079-464e-bce7-34ff0aec537d of volume fa1de0f2-9cb5-4162-b1eb-91935304ee4d {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:00:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] snapshot_file for this snap is: volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:00:04 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6dbc91-8884-4cb9-a46c-6f17ed83608e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:04 devstack sudo[84184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d Feb 24 11:00:04 devstack sudo[84184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:04 devstack sudo[84182]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 1073741824" returned: 0 in 0.677s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:04 devstack sudo[84189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 Feb 24 11:00:04 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:05 devstack sudo[84184]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d" returned: 0 in 0.997s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2fa9b7-10c3-468f-a339-5ed2fe37d2f2]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:05 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7" returned: 0 in 0.682s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:05 devstack sudo[84195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d Feb 24 11:00:05 devstack sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b7987b-5b2d-422b-b321-b1d7ebc7c521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d20204-356a-44df-af17-2b5d789a21d7', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9d9a8e-bc20-4013-b248-72ed57ff9f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:05 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Volume volume-80d20204-356a-44df-af17-2b5d789a21d7 (80d20204-356a-44df-af17-2b5d789a21d7): created successfully Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9d9a8e-bc20-4013-b248-72ed57ff9f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Flow 'volume_create_manager' (9d273c3c-f947-4aaa-ace3-1019c29afaf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:05 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4a9d7a12-f0b9-4d4b-9456-92998a97ad49 tempest-VolumesListAdminTestJSON-1002853530 None] Created volume successfully. Feb 24 11:00:05 devstack sudo[84195]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" returned: 0 in 0.723s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:05 devstack sudo[84200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d Feb 24 11:00:05 devstack sudo[84200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Flow 'volume_create_manager' (29ed6b2a-0925-4cbe-99c0-872138704f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc435d6-ea17-4d9f-9229-8521138d496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc435d6-ea17-4d9f-9229-8521138d496d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2091240242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f58c0a-e2ea-4d3f-b68c-9fea82d5e765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d2b52b5ad140939d13d1038b1993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:06Z,use_quota=True,user_id='72c286aff5ca41fda33323d7ee9ab812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cc5b32-751a-48d5-b495-8abce1bcd8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cc5b32-751a-48d5-b495-8abce1bcd8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d08302-c3c2-4440-99af-b1c4b40c241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d08302-c3c2-4440-99af-b1c4b40c241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f58c0a-e2ea-4d3f-b68c-9fea82d5e765', 'volume_name': 'volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe2c09a-f279-487d-911e-340ae4b57dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe2c09a-f279-487d-911e-340ae4b57dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45d537c-99c1-4949-8362-441ed795e77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:05 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Volume 06f58c0a-e2ea-4d3f-b68c-9fea82d5e765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765', 'volume_size': 1} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2091240242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f58c0a-e2ea-4d3f-b68c-9fea82d5e765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d2b52b5ad140939d13d1038b1993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:06Z,use_quota=True,user_id='72c286aff5ca41fda33323d7ee9ab812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Creating volume 06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:05 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:05 devstack sudo[84202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 1073741824 Feb 24 11:00:05 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:06 devstack sudo[84200]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d" returned: 0 in 0.725s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:06 devstack sudo[84209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d Feb 24 11:00:06 devstack sudo[84209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:06 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 1073741824" returned: 0 in 0.847s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:06 devstack sudo[84212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 Feb 24 11:00:06 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:06 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Flow 'volume_create_manager' (8260d62e-000c-4fb6-afb9-e4a3bc0bc6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384a9368-0896-470f-abb2-2e472877c2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384a9368-0896-470f-abb2-2e472877c2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8efa87-9bf5-418c-88c6-708b975af30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd78d9387484f7da316c1abbd5c2e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:07Z,use_quota=True,user_id='31d06137761d4f50b72cd06c9e4d26db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de88c4ec-10ad-4250-9000-f0f1121baa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de88c4ec-10ad-4250-9000-f0f1121baa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9783f34d-29cb-4853-a094-b0b5dc06b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9783f34d-29cb-4853-a094-b0b5dc06b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8efa87-9bf5-418c-88c6-708b975af30c', 'volume_name': 'volume-9d8efa87-9bf5-418c-88c6-708b975af30c', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737bea21-e7a4-4327-899f-ecf693b2a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737bea21-e7a4-4327-899f-ecf693b2a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d777dd11-581d-4f89-a414-2e1d22730396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:07 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Volume 9d8efa87-9bf5-418c-88c6-708b975af30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8efa87-9bf5-418c-88c6-708b975af30c', 'volume_size': 1} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:07 devstack sudo[84209]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d.56bfa801-4079-464e-bce7-34ff0aec537d" returned: 0 in 0.704s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-quobyte-56bfa801-4079-464e-bce7-34ff0aec537d" released by "_delete_snapshot" :: held 3.214s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-quobyte-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" released by "delete_snapshot" :: held 3.232s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:07 devstack cinder-volume[82627]: WARNING cinder.quota [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.quota [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Created reservations ['e7e8f892-990c-4817-8a67-af1507e9bb85', '1a60400e-6f95-468d-8574-9ec6587e9d39', '8ece5a30-5c97-4ade-9f39-dddb81aa80da', 'ddfe6712-42e6-410f-9899-7b9332e5e08c'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:07 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Delete snapshot completed successfully. Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-7f9a9ee4-3a52-4079-af28-9e21b336c1ce req-98d67263-42ed-440a-bb18-3327e784a6b8 tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-56bfa801-4079-464e-bce7-34ff0aec537d-delete_snapshot" released by "delete_snapshot" :: held 3.359s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:07 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765" returned: 0 in 0.544s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8efa87-9bf5-418c-88c6-708b975af30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd78d9387484f7da316c1abbd5c2e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:07Z,use_quota=True,user_id='31d06137761d4f50b72cd06c9e4d26db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Creating volume 9d8efa87-9bf5-418c-88c6-708b975af30c {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:07 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45d537c-99c1-4949-8362-441ed795e77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a671bae-902a-4361-ae45-3b7d7553196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:07 devstack sudo[84216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c 1073741824 Feb 24 11:00:07 devstack sudo[84216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:07 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Volume volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 (06f58c0a-e2ea-4d3f-b68c-9fea82d5e765): created successfully Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a671bae-902a-4361-ae45-3b7d7553196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Flow 'volume_create_manager' (29ed6b2a-0925-4cbe-99c0-872138704f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:07 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7a46675b-e40e-4657-af32-9bbe3b54fc7b tempest-ServersNegativeTestJSON-1200162331 None] Created volume successfully. Feb 24 11:00:07 devstack sudo[84216]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c 1073741824" returned: 0 in 0.612s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:08 devstack sudo[84225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c Feb 24 11:00:08 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "cinder-fa1de0f2-9cb5-4162-b1eb-91935304ee4d-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-fa1de0f2-9cb5-4162-b1eb-91935304ee4d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "cinder-quobyte-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-quobyte-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc54ea9-3926-49c3-bd08-364f5c409587]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:08 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c" returned: 0 in 0.598s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:08 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d Feb 24 11:00:08 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d777dd11-581d-4f89-a414-2e1d22730396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8efa87-9bf5-418c-88c6-708b975af30c', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63e3ab5-8b0e-4859-8bab-bf53a8e9bb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:08 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Volume volume-9d8efa87-9bf5-418c-88c6-708b975af30c (9d8efa87-9bf5-418c-88c6-708b975af30c): created successfully Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63e3ab5-8b0e-4859-8bab-bf53a8e9bb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Flow 'volume_create_manager' (8260d62e-000c-4fb6-afb9-e4a3bc0bc6d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:08 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6a9ad0ed-2908-4ea0-b73d-1feab6af5164 tempest-VolumesListAdminTestJSON-641193481 None] Created volume successfully. Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Flow 'volume_create_manager' (2b98edbe-9a48-447a-b351-2b60f5c11e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e396165f-db28-4703-a03f-4d573ffb0aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e396165f-db28-4703-a03f-4d573ffb0aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1844083438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c0dc52-b9ef-4b7e-97fc-16698806a9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d2b52b5ad140939d13d1038b1993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:09Z,use_quota=True,user_id='72c286aff5ca41fda33323d7ee9ab812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e79f5ad-4d73-4e26-bebe-619473f3ff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e79f5ad-4d73-4e26-bebe-619473f3ff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6730799-4305-4d98-826f-0f955a194b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6730799-4305-4d98-826f-0f955a194b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c0dc52-b9ef-4b7e-97fc-16698806a9d5', 'volume_name': 'volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fba03a7-3a7f-4561-8f81-ce3e397c0a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fba03a7-3a7f-4561-8f81-ce3e397c0a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496ff580-67b9-461b-8732-cfd292fd925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:08 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Volume 05c0dc52-b9ef-4b7e-97fc-16698806a9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5', 'volume_size': 1} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1844083438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c0dc52-b9ef-4b7e-97fc-16698806a9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d2b52b5ad140939d13d1038b1993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:09Z,use_quota=True,user_id='72c286aff5ca41fda33323d7ee9ab812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Creating volume 05c0dc52-b9ef-4b7e-97fc-16698806a9d5 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:08 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:08 devstack sudo[84230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 1073741824 Feb 24 11:00:09 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:09 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" returned: 0 in 0.656s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Acquiring lock "cinder-9d8efa87-9bf5-418c-88c6-708b975af30c-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Lock "cinder-9d8efa87-9bf5-418c-88c6-708b975af30c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:09 devstack sudo[84235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d Feb 24 11:00:09 devstack sudo[84235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Acquiring lock "cinder-quobyte-9d8efa87-9bf5-418c-88c6-708b975af30c" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Lock "cinder-quobyte-9d8efa87-9bf5-418c-88c6-708b975af30c" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69dcb80-c084-486f-823e-03c5f6c7cef7]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "cinder-80d20204-356a-44df-af17-2b5d789a21d7-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-80d20204-356a-44df-af17-2b5d789a21d7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "cinder-quobyte-80d20204-356a-44df-af17-2b5d789a21d7" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-quobyte-80d20204-356a-44df-af17-2b5d789a21d7" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5290f1f5-7a0a-4259-84e8-1eaefa8e2633]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:09 devstack sudo[84237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c Feb 24 11:00:09 devstack sudo[84237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:09 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 1073741824" returned: 0 in 0.683s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:09 devstack sudo[84241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 Feb 24 11:00:09 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:09 devstack sudo[84244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 Feb 24 11:00:09 devstack sudo[84244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:09 devstack sudo[84235]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" returned: 0 in 0.688s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-quobyte-fa1de0f2-9cb5-4162-b1eb-91935304ee4d" released by "delete_volume" :: held 1.400s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.quota [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Created reservations ['e265792b-d3db-4a63-9b3d-bcd3c7e4c73f', '53e1bb93-c89d-428e-82b0-b2e971284be1', '1e53e3fd-412f-4a4f-8659-cff1592344b2', '735332cf-0955-446d-9e3d-97c8c3d24747'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:10 devstack sudo[84251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:10 devstack sudo[84251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:10 devstack sudo[84237]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c" returned: 0 in 0.768s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:10 devstack sudo[84253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c Feb 24 11:00:10 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:10 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7" returned: 0 in 0.690s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:10 devstack sudo[84259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7 Feb 24 11:00:10 devstack sudo[84259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:10 devstack sudo[84244]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5" returned: 0 in 0.585s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496ff580-67b9-461b-8732-cfd292fd925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a5cdaf-4d6e-4e46-af4a-6d53ea4e7542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:10 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Volume volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 (05c0dc52-b9ef-4b7e-97fc-16698806a9d5): created successfully Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a5cdaf-4d6e-4e46-af4a-6d53ea4e7542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Flow 'volume_create_manager' (2b98edbe-9a48-447a-b351-2b60f5c11e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:10 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f95c66a1-f304-4dd8-91e9-443f1628f339 tempest-ServersNegativeTestJSON-1200162331 None] Created volume successfully. Feb 24 11:00:10 devstack sudo[84251]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.458s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.manager [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:10 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Deleted volume successfully. Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-330558c2-c7da-4343-9901-129647afe887 req-4ed7dfcd-f7b8-4e26-b266-8fec684cf9cd tempest-VolumesSnapshotsTestJSON-1632427690 None] Lock "cinder-fa1de0f2-9cb5-4162-b1eb-91935304ee4d-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:10 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-9d8efa87-9bf5-418c-88c6-708b975af30c" returned: 0 in 0.463s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Lock "cinder-quobyte-9d8efa87-9bf5-418c-88c6-708b975af30c" released by "delete_volume" :: held 1.263s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Created reservations ['884014bc-809d-45f7-bb79-6d570d22d380', 'd43643ec-6191-4469-9097-61d885a338a2', '213c6ff4-2391-4d1a-a23d-b76d16c0b2b6', '6c801028-b603-4a36-9599-ad0ea1fe1958'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:10 devstack sudo[84264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:10 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:10 devstack sudo[84259]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-80d20204-356a-44df-af17-2b5d789a21d7" returned: 0 in 0.485s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-quobyte-80d20204-356a-44df-af17-2b5d789a21d7" released by "delete_volume" :: held 1.202s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Created reservations ['328587d6-148c-4a60-b6ab-7a9c96f19ffd', 'bc816ede-b492-4a7b-8ac1-3bc2cfc4dcf8', '87b17646-3890-4ea6-9fc6-a2acec337a75', '0a3cc4ad-c144-424f-b37d-8715c7c8eb01'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:10 devstack sudo[84266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:10 devstack sudo[84266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:11 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.551s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Deleted volume successfully. Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d38f2e40-c735-464c-ac17-af5f48485d2e tempest-VolumesListAdminTestJSON-641193481 None] Lock "cinder-9d8efa87-9bf5-418c-88c6-708b975af30c-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:11 devstack sudo[84266]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.600s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Deleted volume successfully. Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9f7790e3-bf24-4ad8-8aa1-ff6a464b1ae0 tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-80d20204-356a-44df-af17-2b5d789a21d7-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "cinder-05c0dc52-b9ef-4b7e-97fc-16698806a9d5-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Lock "cinder-05c0dc52-b9ef-4b7e-97fc-16698806a9d5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=77,cinder:UPDATE=102,cinder:DELETE=13,cinder:INSERT=24 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "cinder-quobyte-05c0dc52-b9ef-4b7e-97fc-16698806a9d5" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Lock "cinder-quobyte-05c0dc52-b9ef-4b7e-97fc-16698806a9d5" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "cinder-b7a55912-a7d8-4e96-a29c-35d7553b327a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3c68fe-1bd1-4c48-b11d-51601bf56a0b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-b7a55912-a7d8-4e96-a29c-35d7553b327a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "cinder-quobyte-b7a55912-a7d8-4e96-a29c-35d7553b327a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-quobyte-b7a55912-a7d8-4e96-a29c-35d7553b327a" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[555f0175-6798-466c-8d23-a6b6bcc161bc]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:11 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 Feb 24 11:00:11 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:11 devstack sudo[84271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a Feb 24 11:00:11 devstack sudo[84271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:12 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5" returned: 0 in 0.583s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:12 devstack sudo[84280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5 Feb 24 11:00:12 devstack sudo[84280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:12 devstack sudo[84271]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a" returned: 0 in 0.566s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:12 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a Feb 24 11:00:12 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:12 devstack sudo[84280]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-05c0dc52-b9ef-4b7e-97fc-16698806a9d5" returned: 0 in 0.609s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Lock "cinder-quobyte-05c0dc52-b9ef-4b7e-97fc-16698806a9d5" released by "delete_volume" :: held 1.224s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=85,cinder:UPDATE=104,cinder:INSERT=20,cinder:DELETE=6 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Created reservations ['bdd67ba5-5632-4483-bcc1-1772ad688efd', 'ffb1828a-5750-43da-8a72-4cc0b5a19988', 'b6cffa79-2cf5-4e1d-b44d-d45836f80d47', 'cf3f0215-67a1-40de-b558-e3e28e40b972'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:12 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b7a55912-a7d8-4e96-a29c-35d7553b327a" returned: 0 in 0.618s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-quobyte-b7a55912-a7d8-4e96-a29c-35d7553b327a" released by "delete_volume" :: held 1.217s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:12 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Created reservations ['1be55694-4aad-4116-92e4-d144ee273bfc', 'e0e65f5a-ecbc-4897-8d56-7f000d328cc4', '90374618-011c-4c60-b3ef-f3780392b5e6', '659be2cb-5b48-4d51-95fd-dfad2535a991'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:13 devstack sudo[84286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:13 devstack sudo[84286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:13 devstack sudo[84288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:13 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:13 devstack sudo[84286]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.549s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Deleted volume successfully. Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26410c6b-51f8-4a04-83e3-7e5789347029 tempest-ServersNegativeTestJSON-1200162331 None] Lock "cinder-05c0dc52-b9ef-4b7e-97fc-16698806a9d5-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:13 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.593s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Deleted volume successfully. Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-202ac93a-6398-4f23-8508-6105269f2d9a tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-b7a55912-a7d8-4e96-a29c-35d7553b327a-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Flow 'volume_create_manager' (fdca556e-4b71-4034-83a9-328a6d282186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930ebe99-48fe-4c46-83d3-c305753e4432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930ebe99-48fe-4c46-83d3-c305753e4432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1794598259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19303f2-d4fe-4d8c-9788-111b3760937d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='611d4b656786438588c21b3d52d26fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:14Z,use_quota=True,user_id='1a02189a8e494c02a2b4da35fb72ab80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283fd1b5-0ada-4819-acfc-829e27fd90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283fd1b5-0ada-4819-acfc-829e27fd90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac574ce1-ac9e-4ea1-bcd8-f0502dfab315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac574ce1-ac9e-4ea1-bcd8-f0502dfab315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19303f2-d4fe-4d8c-9788-111b3760937d', 'volume_name': 'volume-f19303f2-d4fe-4d8c-9788-111b3760937d', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3535354-79d1-4ac5-9f4e-b42e4fb0798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3535354-79d1-4ac5-9f4e-b42e4fb0798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e4e154-c500-46f3-ba3a-d980465099a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:13 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Volume f19303f2-d4fe-4d8c-9788-111b3760937d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19303f2-d4fe-4d8c-9788-111b3760937d', 'volume_size': 1} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1794598259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19303f2-d4fe-4d8c-9788-111b3760937d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='611d4b656786438588c21b3d52d26fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:14Z,use_quota=True,user_id='1a02189a8e494c02a2b4da35fb72ab80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Creating volume f19303f2-d4fe-4d8c-9788-111b3760937d {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:13 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "cinder-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Lock "cinder-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:13 devstack sudo[84293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d 1073741824 Feb 24 11:00:13 devstack sudo[84293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "cinder-quobyte-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Lock "cinder-quobyte-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312e2fe-fe8c-4388-a3af-cf04ef26b067]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "cinder-f1d11d69-04df-459d-82f3-b2948edbb7a7-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-f1d11d69-04df-459d-82f3-b2948edbb7a7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "cinder-quobyte-f1d11d69-04df-459d-82f3-b2948edbb7a7" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-quobyte-f1d11d69-04df-459d-82f3-b2948edbb7a7" acquired by "delete_volume" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:13 devstack sudo[84295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 Feb 24 11:00:14 devstack sudo[84295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c6ee81-f40c-4383-8849-c8cd70753b5d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:14 devstack sudo[84297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 Feb 24 11:00:14 devstack sudo[84297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:14 devstack sudo[84293]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d 1073741824" returned: 0 in 0.566s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:14 devstack sudo[84295]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765" returned: 0 in 0.525s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:14 devstack sudo[84318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d Feb 24 11:00:14 devstack sudo[84318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:14 devstack sudo[84319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765 Feb 24 11:00:14 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:14 devstack sudo[84297]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7" returned: 0 in 0.595s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:14 devstack sudo[84327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7 Feb 24 11:00:14 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:14 devstack sudo[84318]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d" returned: 0 in 0.509s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e4e154-c500-46f3-ba3a-d980465099a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19303f2-d4fe-4d8c-9788-111b3760937d', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0364646-931f-418f-ab1e-494f3ad41f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:14 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765" returned: 0 in 0.527s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:14 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Volume volume-f19303f2-d4fe-4d8c-9788-111b3760937d (f19303f2-d4fe-4d8c-9788-111b3760937d): created successfully Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0364646-931f-418f-ab1e-494f3ad41f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Flow 'volume_create_manager' (fdca556e-4b71-4034-83a9-328a6d282186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Lock "cinder-quobyte-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765" released by "delete_volume" :: held 1.103s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-7d7131ed-a7c6-4f96-bf73-d294101a0fcc req-4efdee65-6ece-4b10-9b99-63c85fc8f745 tempest-VolumesGetTestJSON-119636654 None] Created volume successfully. Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Created reservations ['42cfe3d7-a8ee-48ff-8aa0-d08cc083de79', '8c317717-5cec-4336-9649-3eae820f083d', 'eba31e1b-5a1c-4fe4-a3bb-3172cc587f12', '14157621-41b2-493b-b695-dfa23444f121'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:15 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f1d11d69-04df-459d-82f3-b2948edbb7a7" returned: 0 in 0.471s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-quobyte-f1d11d69-04df-459d-82f3-b2948edbb7a7" released by "delete_volume" :: held 1.102s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:15 devstack sudo[84332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:15 devstack sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Created reservations ['4622c234-20a6-4587-a1c4-e095a2146c65', 'dbb97076-4119-48f0-a220-df8e211edd45', '78d50111-157f-4aca-a2b8-262ed7c260c1', '3dc11071-54f8-43f8-bc80-74782772afaf'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:15 devstack sudo[84334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:15 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:15 devstack sudo[84332]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.385s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Deleted volume successfully. Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bb0f310f-e4c6-45a5-90c7-e3efe686d172 tempest-ServersNegativeTestJSON-1200162331 None] Lock "cinder-06f58c0a-e2ea-4d3f-b68c-9fea82d5e765-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:15 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.390s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Deleted volume successfully. Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8c942ba8-6158-483b-bf18-8b4a914040ae tempest-VolumesListAdminTestJSON-1002853530 None] Lock "cinder-f1d11d69-04df-459d-82f3-b2948edbb7a7-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Acquiring lock "cinder-f19303f2-d4fe-4d8c-9788-111b3760937d-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Lock "cinder-f19303f2-d4fe-4d8c-9788-111b3760937d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Acquiring lock "cinder-quobyte-f19303f2-d4fe-4d8c-9788-111b3760937d" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Lock "cinder-quobyte-f19303f2-d4fe-4d8c-9788-111b3760937d" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:16 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[abab02df-abe2-4e5a-a187-40228138c848]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:16 devstack sudo[84338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d Feb 24 11:00:16 devstack sudo[84338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:16 devstack sudo[84338]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d" returned: 0 in 0.604s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:16 devstack sudo[84343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d Feb 24 11:00:16 devstack sudo[84343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:17 devstack sudo[84343]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f19303f2-d4fe-4d8c-9788-111b3760937d" returned: 0 in 0.502s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Lock "cinder-quobyte-f19303f2-d4fe-4d8c-9788-111b3760937d" released by "delete_volume" :: held 1.132s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG cinder.quota [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Created reservations ['19f6f821-c978-44f3-b80b-97a62603dc72', 'c107af20-875a-4228-ab66-5b61cad3e3f2', '86c8a38f-c348-4544-8b51-e1ba4f685704', '54d784d0-c46f-4334-95c5-9bec5342c626'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:17 devstack sudo[84360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:17 devstack sudo[84360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:17 devstack sudo[84360]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.508s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG cinder.manager [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:17 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Deleted volume successfully. Feb 24 11:00:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-14e31b68-1f8b-4789-9fc2-31bc5c452b0b req-650a8453-736e-4d84-87d8-008fadd8297d tempest-VolumesGetTestJSON-119636654 None] Lock "cinder-f19303f2-d4fe-4d8c-9788-111b3760937d-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Flow 'volume_create_manager' (ba77ae3a-cdce-4b6a-b853-6a2aad85bc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78df7a5-698d-4e66-8471-189af320d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78df7a5-698d-4e66-8471-189af320d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1692974102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fabc3a-2001-487a-b141-69ba98746e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f48dbe048f41f390945c68c2b1d7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:23Z,use_quota=True,user_id='c3da080bf91c49fb9f2768b0497b266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d49c7dc-7f76-41f1-a5df-1e64615d3505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d49c7dc-7f76-41f1-a5df-1e64615d3505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee74b99-a579-4f40-bb5a-b8b534fbf260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee74b99-a579-4f40-bb5a-b8b534fbf260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76fabc3a-2001-487a-b141-69ba98746e0a', 'volume_name': 'volume-76fabc3a-2001-487a-b141-69ba98746e0a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e7cf99-240e-476c-b2d2-3b821ff5f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e7cf99-240e-476c-b2d2-3b821ff5f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a289fff-0b89-4060-a403-a77727d82734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:23 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Volume 76fabc3a-2001-487a-b141-69ba98746e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76fabc3a-2001-487a-b141-69ba98746e0a', 'volume_size': 1} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1692974102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fabc3a-2001-487a-b141-69ba98746e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f48dbe048f41f390945c68c2b1d7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:23Z,use_quota=True,user_id='c3da080bf91c49fb9f2768b0497b266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Creating volume 76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:23 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:23 devstack sudo[84414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a 1073741824 Feb 24 11:00:23 devstack sudo[84414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:24 devstack sudo[84414]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a 1073741824" returned: 0 in 0.646s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:24 devstack sudo[84419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a Feb 24 11:00:24 devstack sudo[84419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:24 devstack sudo[84419]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a" returned: 0 in 0.510s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a289fff-0b89-4060-a403-a77727d82734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76fabc3a-2001-487a-b141-69ba98746e0a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86193f56-fb68-4077-9609-d924250f60f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:24 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Volume volume-76fabc3a-2001-487a-b141-69ba98746e0a (76fabc3a-2001-487a-b141-69ba98746e0a): created successfully Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86193f56-fb68-4077-9609-d924250f60f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Flow 'volume_create_manager' (ba77ae3a-cdce-4b6a-b853-6a2aad85bc72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:24 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-1fc5b4fe-e4a6-40b6-987a-040243967820 tempest-VolumesDeleteCascade-2004058870 None] Created volume successfully. Feb 24 11:00:25 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ea902ef7-9f4d-4c5f-9e24-833a7a522b14 tempest-GroupsV320Test-969210160 None] Group tempest-GroupsV320Test-Group-1910929991: creating Feb 24 11:00:25 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ea902ef7-9f4d-4c5f-9e24-833a7a522b14 tempest-GroupsV320Test-969210160 None] Group tempest-GroupsV320Test-Group-1910929991: created successfully Feb 24 11:00:25 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ea902ef7-9f4d-4c5f-9e24-833a7a522b14 tempest-GroupsV320Test-969210160 None] Create group completed successfully. Feb 24 11:00:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Creating offline snapshot 28b34905-63d8-4887-841b-1df6b2118761 of volume 76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:00:25 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc424ce1-9504-405c-a658-a3eef2f3d110]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:25 devstack sudo[84434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a Feb 24 11:00:25 devstack sudo[84434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:26 devstack sudo[84434]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a" returned: 0 in 0.701s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:26 devstack sudo[84457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 1G Feb 24 11:00:26 devstack sudo[84457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Created reservations ['56b3b826-7e0f-4928-81a9-86c903f120bb'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:27 devstack sudo[84457]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 1G" returned: 0 in 0.815s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:27 devstack sudo[84462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 Feb 24 11:00:27 devstack sudo[84462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:27 devstack sudo[84465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:27 devstack sudo[84465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:27 devstack sudo[84462]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761" returned: 0 in 0.577s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:27 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 is being set with open permissions: ugo+rw Feb 24 11:00:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:28 devstack sudo[84471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 Feb 24 11:00:28 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:28 devstack sudo[84465]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.869s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3e4b86c5-e793-4429-88ed-383cd957388e tempest-GroupsV320Test-969210160 None] Delete group completed successfully. Feb 24 11:00:28 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761" returned: 0 in 0.753s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:28 devstack sudo[84476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.info Feb 24 11:00:28 devstack sudo[84476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Flow 'volume_create_manager' (5bf2d722-af82-40b0-b1c7-147834939ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370e69ee-9441-4665-ae77-94b775492dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370e69ee-9441-4665-ae77-94b775492dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-446698830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e0d486-0772-4483-8881-c39ccd4c8596,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbf224668204a15948408f1894c1de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:29Z,use_quota=True,user_id='053c73fd39e34cda967e41f5d6e98473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1da27ac-0ffc-4e7b-a95d-8cace861c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1da27ac-0ffc-4e7b-a95d-8cace861c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116a7b8f-b3ee-4b33-a1d2-7fa256d69a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116a7b8f-b3ee-4b33-a1d2-7fa256d69a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e0d486-0772-4483-8881-c39ccd4c8596', 'volume_name': 'volume-83e0d486-0772-4483-8881-c39ccd4c8596', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b1d2d8-76db-48b3-afe0-9543f74b2211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b1d2d8-76db-48b3-afe0-9543f74b2211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6190ec3f-acc5-482b-9a83-e99ba957a9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:29 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Volume 83e0d486-0772-4483-8881-c39ccd4c8596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e0d486-0772-4483-8881-c39ccd4c8596', 'volume_size': 1} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:29 devstack sudo[84476]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.info" returned: 0 in 0.538s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:29 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.info is being set with open permissions: ugo+rw Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:29 devstack sudo[84479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.info Feb 24 11:00:29 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:29 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.info" returned: 0 in 0.432s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.889s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-446698830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e0d486-0772-4483-8881-c39ccd4c8596,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbf224668204a15948408f1894c1de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:29Z,use_quota=True,user_id='053c73fd39e34cda967e41f5d6e98473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Creating volume 83e0d486-0772-4483-8881-c39ccd4c8596 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:29 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:29 devstack sudo[84482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 1073741824 Feb 24 11:00:29 devstack sudo[84482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:29 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e9a5bede-b48e-4aa8-b806-543cadb220a0 tempest-VolumesDeleteCascade-2004058870 None] Create snapshot completed successfully Feb 24 11:00:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:30 devstack sudo[84482]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 1073741824" returned: 0 in 0.696s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:30 devstack sudo[84487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 Feb 24 11:00:30 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:31 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596" returned: 0 in 0.562s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.801s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6190ec3f-acc5-482b-9a83-e99ba957a9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e0d486-0772-4483-8881-c39ccd4c8596', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dde756-28ee-4265-a79e-7935a62610ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Creating offline snapshot ae98909d-f1d2-44f0-86be-fb6d82cda557 of volume 76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:00:31 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Volume volume-83e0d486-0772-4483-8881-c39ccd4c8596 (83e0d486-0772-4483-8881-c39ccd4c8596): created successfully Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dde756-28ee-4265-a79e-7935a62610ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Flow 'volume_create_manager' (5bf2d722-af82-40b0-b1c7-147834939ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb03fe5-c88e-433c-9edb-bcbb02b47022]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:31 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-68fa3dde-2a36-43dc-ac7b-f5cac399fabd tempest-VolumesTestJSON-1616991828 None] Created volume successfully. Feb 24 11:00:31 devstack sudo[84493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 Feb 24 11:00:31 devstack sudo[84493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:31 devstack sudo[84493]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761" returned: 0 in 0.642s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76fabc3a-2001-487a-b141-69ba98746e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:00:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:31 devstack sudo[84498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 1G Feb 24 11:00:31 devstack sudo[84498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:32 devstack sudo[84498]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 1G" returned: 0 in 0.628s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:32 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 Feb 24 11:00:32 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Flow 'volume_create_manager' (ea1f75b0-b211-4b16-8283-11fb6ca5e20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056620fb-4e2c-4ad1-b677-05f503fe58ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056620fb-4e2c-4ad1-b677-05f503fe58ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1618125072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5afd510-32cc-4a9a-8104-a7380ae1c657,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbf224668204a15948408f1894c1de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:32Z,use_quota=True,user_id='053c73fd39e34cda967e41f5d6e98473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98043b6-5200-48c5-b4d6-23465483a9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98043b6-5200-48c5-b4d6-23465483a9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa5bc12-c7a5-4bda-9eeb-99899d0c5ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa5bc12-c7a5-4bda-9eeb-99899d0c5ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5afd510-32cc-4a9a-8104-a7380ae1c657', 'volume_name': 'volume-c5afd510-32cc-4a9a-8104-a7380ae1c657', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a5d508-c954-4a6c-bcd3-2da308919f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a5d508-c954-4a6c-bcd3-2da308919f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64486d85-df4a-40ac-8242-7ba7dc6c43ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:32 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Volume c5afd510-32cc-4a9a-8104-a7380ae1c657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5afd510-32cc-4a9a-8104-a7380ae1c657', 'volume_size': 1} Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:32 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557" returned: 0 in 0.503s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:32 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 is being set with open permissions: ugo+rw Feb 24 11:00:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:32 devstack sudo[84508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 Feb 24 11:00:32 devstack sudo[84508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Flow 'volume_create_manager' (bc5ac9ee-ce82-4bf6-b6fc-b524aebaa248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95d9f51-951a-4bfa-ba52-b17a3adc15f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95d9f51-951a-4bfa-ba52-b17a3adc15f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1728990899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12259e6-0faa-407e-8f35-86970976e09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ad2a1da7ed43fa8c869ce5459b99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:33Z,use_quota=True,user_id='c8a160e4edcd457d9aec2e562714437e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7187b42f-3630-45df-b094-4c7e9fabc50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7187b42f-3630-45df-b094-4c7e9fabc50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25eacf04-ce31-4fb7-ae4a-cd97db96323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25eacf04-ce31-4fb7-ae4a-cd97db96323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12259e6-0faa-407e-8f35-86970976e09a', 'volume_name': 'volume-d12259e6-0faa-407e-8f35-86970976e09a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7899cc-bbb0-47b8-92e9-d2dbe4b70a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7899cc-bbb0-47b8-92e9-d2dbe4b70a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dcbd36-cfdb-48ab-9bd9-c0cf3d875fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:33 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Volume d12259e6-0faa-407e-8f35-86970976e09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12259e6-0faa-407e-8f35-86970976e09a', 'volume_size': 1} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:33 devstack sudo[84508]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557" returned: 0 in 0.485s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1618125072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5afd510-32cc-4a9a-8104-a7380ae1c657,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbf224668204a15948408f1894c1de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:32Z,use_quota=True,user_id='053c73fd39e34cda967e41f5d6e98473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Creating volume c5afd510-32cc-4a9a-8104-a7380ae1c657 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:33 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:33 devstack sudo[84511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 1073741824 Feb 24 11:00:33 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7bd7b296-ec9d-463f-9a36-1185dcd3d9fb tempest-VolumesDeleteCascade-2004058870 None] Create snapshot completed successfully Feb 24 11:00:33 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 1073741824" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:33 devstack sudo[84516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 Feb 24 11:00:33 devstack sudo[84516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:34 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:34 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:34 devstack sudo[84516]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657" returned: 0 in 0.480s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1728990899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12259e6-0faa-407e-8f35-86970976e09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ad2a1da7ed43fa8c869ce5459b99b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:33Z,use_quota=True,user_id='c8a160e4edcd457d9aec2e562714437e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Creating volume d12259e6-0faa-407e-8f35-86970976e09a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:34 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:34 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a 1073741824 Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64486d85-df4a-40ac-8242-7ba7dc6c43ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5afd510-32cc-4a9a-8104-a7380ae1c657', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:34 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b08008d-76c7-4f4c-86b2-c3f39e3a9755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:34 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Volume volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 (c5afd510-32cc-4a9a-8104-a7380ae1c657): created successfully Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b08008d-76c7-4f4c-86b2-c3f39e3a9755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Flow 'volume_create_manager' (ea1f75b0-b211-4b16-8283-11fb6ca5e20c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-76fabc3a-2001-487a-b141-69ba98746e0a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-de8df27d-cb0e-4736-aa19-4d715fd67baa tempest-VolumesTestJSON-1616991828 None] Created volume successfully. Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-76fabc3a-2001-487a-b141-69ba98746e0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Performing cascade delete. {{(pid=82627) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 24 11:00:34 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-28b34905-63d8-4887-841b-1df6b2118761-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-28b34905-63d8-4887-841b-1df6b2118761-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-28b34905-63d8-4887-841b-1df6b2118761" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-28b34905-63d8-4887-841b-1df6b2118761" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Deleting offline snapshot 28b34905-63d8-4887-841b-1df6b2118761 of volume 76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] snapshot_file for this snap is: volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff8afe0-1e59-4fc5-bb81-bf6cc8a0ae68]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:34 devstack sudo[84524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 Feb 24 11:00:34 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:34 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Flow 'volume_create_manager' (a00c557a-7faf-47b8-bb8d-4dd1783ffa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3240acb2-3c53-466d-afac-f67d1286191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3240acb2-3c53-466d-afac-f67d1286191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1077859755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a56d6c2-af58-4492-ac43-2d9f05a2b247,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbf224668204a15948408f1894c1de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:35Z,use_quota=True,user_id='053c73fd39e34cda967e41f5d6e98473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b111b64-8f6b-497e-8be1-c941630e4ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b111b64-8f6b-497e-8be1-c941630e4ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0487f57-c519-4556-b0ac-99679ca78640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0487f57-c519-4556-b0ac-99679ca78640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a56d6c2-af58-4492-ac43-2d9f05a2b247', 'volume_name': 'volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facb209f-e2bc-400d-84d0-431d5fd97e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facb209f-e2bc-400d-84d0-431d5fd97e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e4662b-23f4-4630-8532-8ca80cf5251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:35 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Volume 7a56d6c2-af58-4492-ac43-2d9f05a2b247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247', 'volume_size': 1} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:35 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a 1073741824" returned: 0 in 0.736s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:35 devstack sudo[84532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a Feb 24 11:00:35 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:35 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761" returned: 0 in 0.584s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76fabc3a-2001-487a-b141-69ba98746e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[168fac04-d5ee-471a-8754-a59a21dc6b18]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:35 devstack sudo[84534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a Feb 24 11:00:35 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:35 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a" returned: 0 in 0.533s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1077859755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a56d6c2-af58-4492-ac43-2d9f05a2b247,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbf224668204a15948408f1894c1de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:35Z,use_quota=True,user_id='053c73fd39e34cda967e41f5d6e98473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Creating volume 7a56d6c2-af58-4492-ac43-2d9f05a2b247 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:35 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dcbd36-cfdb-48ab-9bd9-c0cf3d875fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12259e6-0faa-407e-8f35-86970976e09a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:35 devstack sudo[84537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 1073741824 Feb 24 11:00:35 devstack sudo[84537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0d2318-f595-40c8-81bc-6b3d1b36216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:35 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Volume volume-d12259e6-0faa-407e-8f35-86970976e09a (d12259e6-0faa-407e-8f35-86970976e09a): created successfully Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0d2318-f595-40c8-81bc-6b3d1b36216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Flow 'volume_create_manager' (bc5ac9ee-ce82-4bf6-b6fc-b524aebaa248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:35 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4f89ecc0-0f58-4275-bb44-4f1967014922 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Created volume successfully. Feb 24 11:00:35 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a" returned: 0 in 0.710s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e5275b-9d01-491f-912c-768495af1aa3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:36 devstack sudo[84543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 Feb 24 11:00:36 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:36 devstack sudo[84537]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 1073741824" returned: 0 in 0.743s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:36 devstack sudo[84548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 Feb 24 11:00:36 devstack sudo[84548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:36 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557" returned: 0 in 0.841s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76fabc3a-2001-487a-b141-69ba98746e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:00:36 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb1b199-2192-4349-9cde-bba1b3786446]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:37 devstack sudo[84553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 Feb 24 11:00:37 devstack sudo[84553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Acquiring lock "cinder-d12259e6-0faa-407e-8f35-86970976e09a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:37 devstack sudo[84548]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Flow 'volume_create_manager' (21a7c551-7b92-4b46-9c4e-8e20603c801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db74fde-7e13-4bf1-b2ba-e82795649cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db74fde-7e13-4bf1-b2ba-e82795649cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:37Z,deleted=False,deleted_at=None,display_description='',display_name='91a8506e-a232-4e5c-82bf-610a9a6d7aa1-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eea4480-f843-4bb4-8df8-8cbd63c7a30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9196d1155245b7ac6a66607abf84d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:37Z,use_quota=True,user_id='1a135edf51ef476d8e593ad39b30a086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c343d893-e1b3-4e6c-9f50-88abf300c480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c343d893-e1b3-4e6c-9f50-88abf300c480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8d1071-8304-4a45-b68c-33d5d344c333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8d1071-8304-4a45-b68c-33d5d344c333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eea4480-f843-4bb4-8df8-8cbd63c7a30e', 'volume_name': 'volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d790633-b19f-4299-827a-7537529cf9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d790633-b19f-4299-827a-7537529cf9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa17b06-0429-4f04-be66-73e9121f83bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:37 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Volume 7eea4480-f843-4bb4-8df8-8cbd63c7a30e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e', 'volume_size': 1} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247" returned: 0 in 1.124s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "cinder-d12259e6-0faa-407e-8f35-86970976e09a-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:37Z,deleted=False,deleted_at=None,display_description='',display_name='91a8506e-a232-4e5c-82bf-610a9a6d7aa1-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eea4480-f843-4bb4-8df8-8cbd63c7a30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9196d1155245b7ac6a66607abf84d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:37Z,use_quota=True,user_id='1a135edf51ef476d8e593ad39b30a086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Creating volume 7eea4480-f843-4bb4-8df8-8cbd63c7a30e {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:37 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:37 devstack sudo[84562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e 1073741824 Feb 24 11:00:37 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Acquiring lock "cinder-quobyte-d12259e6-0faa-407e-8f35-86970976e09a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e4662b-23f4-4630-8532-8ca80cf5251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2244d1ff-132a-426d-9abc-ef79a7c86ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:37 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Volume volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 (7a56d6c2-af58-4492-ac43-2d9f05a2b247): created successfully Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2244d1ff-132a-426d-9abc-ef79a7c86ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Flow 'volume_create_manager' (a00c557a-7faf-47b8-bb8d-4dd1783ffa1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:37 devstack sudo[84553]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "cinder-quobyte-d12259e6-0faa-407e-8f35-86970976e09a" acquired by "delete_volume" :: waited 0.055s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761" returned: 0 in 0.880s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76fabc3a-2001-487a-b141-69ba98746e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b3ea4c-79cd-417a-a0a2-aad0da0c5193]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bea359-f299-422c-806f-b831e22c51e3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:37 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-16d5eb3c-daa1-43bd-b91b-4c4e7aa311f7 tempest-VolumesTestJSON-1616991828 None] Created volume successfully. Feb 24 11:00:37 devstack sudo[84564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a Feb 24 11:00:37 devstack sudo[84564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:37 devstack sudo[84565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a Feb 24 11:00:37 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:38 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e 1073741824" returned: 0 in 0.737s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:38 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a" returned: 0 in 0.709s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:38 devstack sudo[84577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e Feb 24 11:00:38 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:38 devstack sudo[84578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 Feb 24 11:00:38 devstack sudo[84578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:38 devstack sudo[84564]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a" returned: 0 in 0.804s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:38 devstack sudo[84581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a Feb 24 11:00:38 devstack sudo[84581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "cinder-7a56d6c2-af58-4492-ac43-2d9f05a2b247-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-7a56d6c2-af58-4492-ac43-2d9f05a2b247-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "cinder-quobyte-7a56d6c2-af58-4492-ac43-2d9f05a2b247" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-quobyte-7a56d6c2-af58-4492-ac43-2d9f05a2b247" acquired by "delete_volume" :: waited 0.023s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[57652376-ba18-4cdb-9d15-b87493cec26e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:39 devstack sudo[84587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 Feb 24 11:00:39 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:39 devstack sudo[84578]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761" returned: 0 in 0.726s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:39 devstack sudo[84591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761 Feb 24 11:00:39 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:39 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e" returned: 0 in 0.867s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:39 devstack sudo[84581]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa17b06-0429-4f04-be66-73e9121f83bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b25b51-92b2-457f-850f-42bbdea2375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d12259e6-0faa-407e-8f35-86970976e09a" returned: 0 in 0.820s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "cinder-quobyte-d12259e6-0faa-407e-8f35-86970976e09a" released by "delete_volume" :: held 1.666s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:39 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Volume volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e (7eea4480-f843-4bb4-8df8-8cbd63c7a30e): created successfully Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b25b51-92b2-457f-850f-42bbdea2375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Flow 'volume_create_manager' (21a7c551-7b92-4b46-9c4e-8e20603c801f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:39 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-8c02c28e-c185-4ba2-b088-3d7f5e0d465a tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Created volume successfully. Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Created reservations ['1d8df160-8fce-4961-88b2-c26c393b21ee', '7946c101-ff77-49a1-b2a2-edb7b6a3a9d8', '6dc001c5-2cbb-411e-9d13-ddb96abded4d', 'd7bd4e1e-9aee-42c1-8e0b-36b10c2dd1f9'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:39 devstack sudo[84593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:39 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:39 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.28b34905-63d8-4887-841b-1df6b2118761" returned: 0 in 0.691s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 -F qcow2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:39 devstack sudo[84599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 -F qcow2 Feb 24 11:00:39 devstack sudo[84599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:39 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247" returned: 0 in 0.834s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:39 devstack sudo[84601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247 Feb 24 11:00:39 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:40 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.768s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:40 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Deleted volume successfully. Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b305cdf7-4581-407b-9ffc-9b815f0eaba3 tempest-VolumeQuotasNegativeTestJSON-1308728604 None] Lock "cinder-d12259e6-0faa-407e-8f35-86970976e09a-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:40 devstack sudo[84599]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76fabc3a-2001-487a-b141-69ba98746e0a /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 -F qcow2" returned: 0 in 0.576s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-28b34905-63d8-4887-841b-1df6b2118761" released by "_delete_snapshot" :: held 5.833s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" released by "delete_snapshot" :: held 5.848s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Created reservations ['b889e251-f6e7-4659-a9b8-17bec5f56451', 'cc78ed22-4521-4a26-a48c-9ecdbd0ddd38', '8dcb581e-1476-426d-a03b-7b44fc8241f1', 'bf40a33a-167a-470d-b248-c8a749cfa468'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:40 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7a56d6c2-af58-4492-ac43-2d9f05a2b247" returned: 0 in 0.671s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:40 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Delete snapshot completed successfully. Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-quobyte-7a56d6c2-af58-4492-ac43-2d9f05a2b247" released by "delete_volume" :: held 1.563s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-28b34905-63d8-4887-841b-1df6b2118761-delete_snapshot" released by "delete_snapshot" :: held 6.056s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-ae98909d-f1d2-44f0-86be-fb6d82cda557-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Created reservations ['52a04fc0-82a3-488a-a143-ba71f9106932', '53709a26-3d34-4df9-98b4-66abd167cca2', '63e250c9-8b57-479a-a5f2-018305845368', 'dfdab09a-e77e-4c4b-a4c9-394b80b39f7e'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-ae98909d-f1d2-44f0-86be-fb6d82cda557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-ae98909d-f1d2-44f0-86be-fb6d82cda557" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-ae98909d-f1d2-44f0-86be-fb6d82cda557" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Deleting offline snapshot ae98909d-f1d2-44f0-86be-fb6d82cda557 of volume 76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:00:40 devstack sudo[84608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:40 devstack sudo[84608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] snapshot_file for this snap is: volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f31154-3dc8-4703-8e75-8039f349460b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:41 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 Feb 24 11:00:41 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-52a65d2f-5c95-434e-a888-5b1d56194cd4 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-52a65d2f-5c95-434e-a888-5b1d56194cd4 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4c2ee6-f5de-4c91-86e5-c618803fc521]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-52a65d2f-5c95-434e-a888-5b1d56194cd4 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "cinder-c5afd510-32cc-4a9a-8104-a7380ae1c657-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-c5afd510-32cc-4a9a-8104-a7380ae1c657-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:41 devstack sudo[84626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e Feb 24 11:00:41 devstack sudo[84626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "cinder-quobyte-c5afd510-32cc-4a9a-8104-a7380ae1c657" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-quobyte-c5afd510-32cc-4a9a-8104-a7380ae1c657" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf9e792-d1aa-4806-a13c-7c12053bcff6]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:41 devstack sudo[84628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 Feb 24 11:00:41 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:41 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557" returned: 0 in 0.809s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76fabc3a-2001-487a-b141-69ba98746e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adfe58a-a82d-4a0f-984d-8293b4ae05c2]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:41 devstack sudo[84608]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.076s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:41 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Deleted volume successfully. Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7b00e73c-1443-4704-a32f-3d98ddfe3db8 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-7a56d6c2-af58-4492-ac43-2d9f05a2b247-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:41 devstack sudo[84626]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-52a65d2f-5c95-434e-a888-5b1d56194cd4 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e" returned: 0 in 0.815s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-52a65d2f-5c95-434e-a888-5b1d56194cd4 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:41 devstack sudo[84636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a Feb 24 11:00:41 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-52a65d2f-5c95-434e-a888-5b1d56194cd4 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37', 'name': 'volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68bcf703-ee14-4eec-bb9b-f281f83c5782', 'enforce_multipath': True} {{(pid=82627) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 24 11:00:42 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-21011bbf-fb67-4bcd-b84a-1d2c52bfb74a req-52a65d2f-5c95-434e-a888-5b1d56194cd4 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] attachment_update completed successfully. Feb 24 11:00:42 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657" returned: 0 in 0.918s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:42 devstack sudo[84659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657 Feb 24 11:00:42 devstack sudo[84659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:42 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a" returned: 0 in 0.764s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:42 devstack sudo[84664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 Feb 24 11:00:42 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:42 devstack sudo[84659]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c5afd510-32cc-4a9a-8104-a7380ae1c657" returned: 0 in 0.483s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-quobyte-c5afd510-32cc-4a9a-8104-a7380ae1c657" released by "delete_volume" :: held 1.447s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Created reservations ['84fc027b-26a2-4dd5-8dea-a8d8f331ab39', 'acca994a-baff-435b-a631-413812373bfa', 'c5fe9f51-5a62-464b-9b97-a6d36f77126c', 'd9d17c79-7ff1-4ca9-a1db-f80f83a80301'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:42 devstack sudo[84668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:42 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:43 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557" returned: 0 in 0.537s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:43 devstack sudo[84672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557 Feb 24 11:00:43 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:43 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.584s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:43 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Deleted volume successfully. Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6065f85f-bb01-4c50-ac3a-2d1220e06b56 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-c5afd510-32cc-4a9a-8104-a7380ae1c657-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "cinder-83e0d486-0772-4483-8881-c39ccd4c8596-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-83e0d486-0772-4483-8881-c39ccd4c8596-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "cinder-quobyte-83e0d486-0772-4483-8881-c39ccd4c8596" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-quobyte-83e0d486-0772-4483-8881-c39ccd4c8596" acquired by "delete_volume" :: waited 0.006s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ac0701-3863-48bb-8dfc-eab2fa297962]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:43 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a.ae98909d-f1d2-44f0-86be-fb6d82cda557" returned: 0 in 0.696s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-ae98909d-f1d2-44f0-86be-fb6d82cda557" released by "_delete_snapshot" :: held 2.967s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" released by "delete_snapshot" :: held 2.992s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:43 devstack sudo[84676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 Feb 24 11:00:43 devstack sudo[84676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Created reservations ['72be55a2-798e-4787-adf6-0b9a0227ae6e', 'c4e0307a-92be-4ddf-af47-9e71d8a29f76', '53d122b7-cf3f-4f08-9212-08fd649c989a', 'e9e57da9-ee68-4607-95ce-6dac0422fc66'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:43 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Delete snapshot completed successfully. Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-ae98909d-f1d2-44f0-86be-fb6d82cda557-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Snapshots deleted, issuing volume delete {{(pid=82627) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d850c4a3-a781-41f5-9f9c-4bc16241aaf8]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:44 devstack sudo[84678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a Feb 24 11:00:44 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:44 devstack sudo[84676]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596" returned: 0 in 0.611s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:44 devstack sudo[84684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596 Feb 24 11:00:44 devstack sudo[84684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:44 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a" returned: 0 in 0.716s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:44 devstack sudo[84755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a Feb 24 11:00:44 devstack sudo[84755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:44 devstack sudo[84684]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83e0d486-0772-4483-8881-c39ccd4c8596" returned: 0 in 0.708s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-quobyte-83e0d486-0772-4483-8881-c39ccd4c8596" released by "delete_volume" :: held 1.360s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Created reservations ['7d8b381d-2c24-4023-82b6-8fe33da49772', 'e743f1a3-05f6-4d29-a259-a1cef340bc70', '2cf19663-fe38-4f36-bbd0-9f6c3f789c4e', '9cceb911-fca5-4e54-86cf-f61553384598'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:45 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:45 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:45 devstack sudo[84755]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-76fabc3a-2001-487a-b141-69ba98746e0a" returned: 0 in 0.532s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-76fabc3a-2001-487a-b141-69ba98746e0a" released by "delete_volume" :: held 1.277s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Created reservations ['078f0173-5500-4863-9a2a-52f32c67e2b3', 'e33db5ce-e2bc-46a7-9190-5be154f25013', 'd5e1fac9-0637-4d77-ba9c-370aea63fcc9', '122a744d-c066-450b-aaab-6dbf20475f38'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:45 devstack sudo[84761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:45 devstack sudo[84761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:45 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:45 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Deleted volume successfully. Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-654bb095-935d-495f-9d27-10fb585bf249 tempest-VolumesTestJSON-1616991828 None] Lock "cinder-83e0d486-0772-4483-8881-c39ccd4c8596-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:45 devstack sudo[84761]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.518s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:45 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Deleted volume successfully. Feb 24 11:00:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c09db770-3c17-4dc7-9964-674733767e1b tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-76fabc3a-2001-487a-b141-69ba98746e0a-delete_volume" released by "delete_volume" :: held 11.311s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Flow 'volume_create_manager' (e6358af1-b63c-4f1f-81ea-aaf04b2b1f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96f27d9-7815-49ec-be49-cda4462a3041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96f27d9-7815-49ec-be49-cda4462a3041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-369282746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fe0f97-0049-4f24-943a-c1c33db3293f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f48dbe048f41f390945c68c2b1d7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:47Z,use_quota=True,user_id='c3da080bf91c49fb9f2768b0497b266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e358af6-4b90-4933-8c7c-ca9f68cd3f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e358af6-4b90-4933-8c7c-ca9f68cd3f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a76b6d1-626d-4744-ae72-1379e986c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a76b6d1-626d-4744-ae72-1379e986c909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19fe0f97-0049-4f24-943a-c1c33db3293f', 'volume_name': 'volume-19fe0f97-0049-4f24-943a-c1c33db3293f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bbce41-2d10-494a-9d07-9d485269a84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bbce41-2d10-494a-9d07-9d485269a84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5ce710-8a43-4b25-a135-a7d50d8a0f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:46 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Volume 19fe0f97-0049-4f24-943a-c1c33db3293f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19fe0f97-0049-4f24-943a-c1c33db3293f', 'volume_size': 1} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-369282746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fe0f97-0049-4f24-943a-c1c33db3293f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f48dbe048f41f390945c68c2b1d7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:47Z,use_quota=True,user_id='c3da080bf91c49fb9f2768b0497b266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Creating volume 19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:46 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:46 devstack sudo[84768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f 1073741824 Feb 24 11:00:46 devstack sudo[84768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:47 devstack sudo[84768]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f 1073741824" returned: 0 in 1.014s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:48 devstack sudo[85112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f Feb 24 11:00:48 devstack sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:48 devstack sudo[85112]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f" returned: 0 in 0.689s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5ce710-8a43-4b25-a135-a7d50d8a0f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19fe0f97-0049-4f24-943a-c1c33db3293f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5373ed0c-d079-4090-96e2-484a1f5f757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:48 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Volume volume-19fe0f97-0049-4f24-943a-c1c33db3293f (19fe0f97-0049-4f24-943a-c1c33db3293f): created successfully Feb 24 11:00:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5373ed0c-d079-4090-96e2-484a1f5f757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Flow 'volume_create_manager' (e6358af1-b63c-4f1f-81ea-aaf04b2b1f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:48 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-135762a8-00ba-468d-b0cc-fa6e3257ff14 tempest-VolumesDeleteCascade-2004058870 None] Created volume successfully. Feb 24 11:00:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Creating offline snapshot 02ee0a23-568a-42d8-b807-493150c1a772 of volume 19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:00:49 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ff1e0f-3f09-4042-90e1-4f1599f891c6]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:49 devstack sudo[85115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f Feb 24 11:00:49 devstack sudo[85115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:49 devstack sudo[85115]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f" returned: 0 in 0.601s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:49 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 1G Feb 24 11:00:49 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53075048-826c-4a5b-96ed-04c57679cc95 tempest-BackendsCapabilitiesAdminTestsJSON-1247746599 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6931190490723, 'free_capacity_gb': 1775.6931190490723, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82627) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 24 11:00:50 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 1G" returned: 0 in 0.565s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19fe0f97-0049-4f24-943a-c1c33db3293f -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:50 devstack sudo[85125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19fe0f97-0049-4f24-943a-c1c33db3293f -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 Feb 24 11:00:50 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e8b9efe-a9a6-4c58-82b2-e835879a0871 tempest-BackendsCapabilitiesAdminTestsJSON-1247746599 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6931190490723, 'free_capacity_gb': 1775.6931190490723, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82627) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 24 11:00:50 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19fe0f97-0049-4f24-943a-c1c33db3293f -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772" returned: 0 in 0.496s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:50 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 is being set with open permissions: ugo+rw Feb 24 11:00:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:50 devstack sudo[85130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 Feb 24 11:00:50 devstack sudo[85130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Flow 'volume_create_manager' (e6e76f78-e354-4e44-a0b4-e57760959417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a681a23b-785b-4155-9e87-ddcfcd5583b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a681a23b-785b-4155-9e87-ddcfcd5583b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-758790423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef25c111-c3e9-4abb-bd22-56fb51ed7d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e76f86842b462295dede87297be6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:51Z,use_quota=True,user_id='ace871f2b2dd4c6bb3b2bcaf0f84eb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b21d743-a3f4-49b4-b5f8-ecf59632bc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b21d743-a3f4-49b4-b5f8-ecf59632bc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229a8c61-8b1d-4cb5-ab9e-a580b4dd3f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229a8c61-8b1d-4cb5-ab9e-a580b4dd3f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef25c111-c3e9-4abb-bd22-56fb51ed7d31', 'volume_name': 'volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2632dee-3bfd-4675-9d96-33709da45142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2632dee-3bfd-4675-9d96-33709da45142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f26011-e846-4607-a548-945997d7af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:51 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Volume ef25c111-c3e9-4abb-bd22-56fb51ed7d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31', 'volume_size': 1} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:51 devstack sudo[85130]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772" returned: 0 in 0.470s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:51 devstack sudo[85133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.info Feb 24 11:00:51 devstack sudo[85133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:51 devstack sudo[85133]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.info" returned: 0 in 0.445s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:51 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.info is being set with open permissions: ugo+rw Feb 24 11:00:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:51 devstack sudo[85136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.info Feb 24 11:00:51 devstack sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:52 devstack sudo[85136]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.info" returned: 0 in 0.613s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.261s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-758790423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef25c111-c3e9-4abb-bd22-56fb51ed7d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e76f86842b462295dede87297be6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:51Z,use_quota=True,user_id='ace871f2b2dd4c6bb3b2bcaf0f84eb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Creating volume ef25c111-c3e9-4abb-bd22-56fb51ed7d31 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:52 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:52 devstack sudo[85139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 1073741824 Feb 24 11:00:52 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:52 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-413428a1-244e-47ad-bd3c-f2f9f88fac54 tempest-VolumesDeleteCascade-2004058870 None] Create snapshot completed successfully Feb 24 11:00:53 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 1073741824" returned: 0 in 0.535s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:53 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 Feb 24 11:00:53 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:53 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31" returned: 0 in 0.505s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f26011-e846-4607-a548-945997d7af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6c4612-d0c4-4979-92d7-405a468c14e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:53 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Volume volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 (ef25c111-c3e9-4abb-bd22-56fb51ed7d31): created successfully Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6c4612-d0c4-4979-92d7-405a468c14e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Flow 'volume_create_manager' (e6e76f78-e354-4e44-a0b4-e57760959417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:53 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8669ecf8-0772-4fb6-8bcd-1bab508e3f6a tempest-VolumesTransfersTest-424686276 None] Created volume successfully. Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Flow 'volume_create_manager' (4af9f0cf-07ad-4fe8-a63e-b45a8dad14f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97bb9f5-933e-42c1-8a83-ed94390dcffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97bb9f5-933e-42c1-8a83-ed94390dcffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-946800563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a36b06f-ce43-4885-a680-683b3905e174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f48dbe048f41f390945c68c2b1d7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02ee0a23-568a-42d8-b807-493150c1a772,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:54Z,use_quota=True,user_id='c3da080bf91c49fb9f2768b0497b266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7305b4e9-dbbc-4b47-8e1f-d2d0b0b004bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7305b4e9-dbbc-4b47-8e1f-d2d0b0b004bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf12cc10-89fe-4a48-9e54-31ae1178a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf12cc10-89fe-4a48-9e54-31ae1178a52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a36b06f-ce43-4885-a680-683b3905e174', 'volume_name': 'volume-0a36b06f-ce43-4885-a680-683b3905e174', 'volume_size': 1, 'snapshot_id': '02ee0a23-568a-42d8-b807-493150c1a772'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ed293f-4c4b-471d-95aa-cadf62a724ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ed293f-4c4b-471d-95aa-cadf62a724ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4d9860-280f-44c6-8b72-dec54b217ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:53 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Volume 0a36b06f-ce43-4885-a680-683b3905e174: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a36b06f-ce43-4885-a680-683b3905e174', 'volume_size': 1, 'snapshot_id': '02ee0a23-568a-42d8-b807-493150c1a772'} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-02ee0a23-568a-42d8-b807-493150c1a772-0a36b06f-ce43-4885-a680-683b3905e174" by "_create_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-02ee0a23-568a-42d8-b807-493150c1a772-0a36b06f-ce43-4885-a680-683b3905e174" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Creating volume 0a36b06f-ce43-4885-a680-683b3905e174 from snapshot 02ee0a23-568a-42d8-b807-493150c1a772 {{(pid=82627) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-0a36b06f-ce43-4885-a680-683b3905e174" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-0a36b06f-ce43-4885-a680-683b3905e174" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] snapshot: 02ee0a23-568a-42d8-b807-493150c1a772, volume: 0a36b06f-ce43-4885-a680-683b3905e174, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e8098e-ef0d-43e0-93df-57770f68428b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:53 devstack sudo[85187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 Feb 24 11:00:53 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:54 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772" returned: 0 in 0.618s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19fe0f97-0049-4f24-943a-c1c33db3293f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:00:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:00:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:00:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f510c675-f6e7-458d-aa45-11c67387f2b5]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-560d171d-5fa9-4809-9f84-667bb0518084 tempest-GroupSnapshotsTest-1549686521 None] Group tempest-GroupSnapshotsTest-Group-636054782: creating Feb 24 11:00:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-560d171d-5fa9-4809-9f84-667bb0518084 tempest-GroupSnapshotsTest-1549686521 None] Group tempest-GroupSnapshotsTest-Group-636054782: created successfully Feb 24 11:00:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-560d171d-5fa9-4809-9f84-667bb0518084 tempest-GroupSnapshotsTest-1549686521 None] Create group completed successfully. Feb 24 11:00:54 devstack sudo[85199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f Feb 24 11:00:54 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-75a1bf4d-4b55-4f18-aa4f-da42901c69d4 tempest-VolumesTransfersTest-1352999577 None] Transfer volume completed successfully. Feb 24 11:00:55 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f" returned: 0 in 0.611s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:55 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:00:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:55 devstack sudo[85220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 Feb 24 11:00:55 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Acquiring lock "cinder-ef25c111-c3e9-4abb-bd22-56fb51ed7d31-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Lock "cinder-ef25c111-c3e9-4abb-bd22-56fb51ed7d31-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Acquiring lock "cinder-quobyte-ef25c111-c3e9-4abb-bd22-56fb51ed7d31" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Flow 'volume_create_manager' (e69cea08-95e5-4358-9d0e-9ba2fc9dac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd2fe62-0ea0-4239-87d1-efcec5a228e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Lock "cinder-quobyte-ef25c111-c3e9-4abb-bd22-56fb51ed7d31" acquired by "delete_volume" :: waited 0.174s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d362d891-98fd-4baa-874e-f36199ce14de]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd2fe62-0ea0-4239-87d1-efcec5a228e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-356877788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5563ab1e-ff7a-4f49-9294-84daf684cc9b,host='devstack@QuobyteHD#QuobyteHD',id=bfe831f0-bb9b-4147-a035-061a952289c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d7afac769b4e6c935c1ca2b142e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:56Z,use_quota=True,user_id='ee037e83f9f244ae914aff8a29c5a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587cadca-ff55-40e5-b079-b51d0d44858d),volume_type_id=587cadca-ff55-40e5-b079-b51d0d44858d)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e1f875-2323-40fc-b1e6-f1ed6fde5d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e1f875-2323-40fc-b1e6-f1ed6fde5d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8d1e6d-7b5d-41bd-b887-2ddc33b72cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8d1e6d-7b5d-41bd-b887-2ddc33b72cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe831f0-bb9b-4147-a035-061a952289c3', 'volume_name': 'volume-bfe831f0-bb9b-4147-a035-061a952289c3', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351828bc-51d0-44db-8d2c-e3fa60deab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351828bc-51d0-44db-8d2c-e3fa60deab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e710873a-8192-41d1-8aca-15bb2c77fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:57 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Volume bfe831f0-bb9b-4147-a035-061a952289c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe831f0-bb9b-4147-a035-061a952289c3', 'volume_size': 1} Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:57 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 Feb 24 11:00:57 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:57 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174" returned: 0 in 2.784s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[822269a4-1df9-404e-b20c-3e4d6080ac0f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:58 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f Feb 24 11:00:58 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:58 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31" returned: 0 in 1.187s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:58 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31 Feb 24 11:00:58 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:58 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ef25c111-c3e9-4abb-bd22-56fb51ed7d31" returned: 0 in 0.384s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Lock "cinder-quobyte-ef25c111-c3e9-4abb-bd22-56fb51ed7d31" released by "delete_volume" :: held 1.622s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Created reservations ['24cb4b47-4d49-443c-a29c-b14e001c9253', '2e8db5a3-3374-4c3e-890c-7c85eb75bab8', '530d765f-6f35-4314-8623-f9321e3973df', '73a7de48-164b-4f04-84ba-f12306e94bc4'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:00:58 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f" returned: 0 in 0.603s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f, size 1024.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:00:58 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Converted 1024.00 MB image at 367.60 MB/s Feb 24 11:00:58 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 is being set with open permissions: ugo+rw Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:58 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 Feb 24 11:00:58 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:58 devstack sudo[85279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:00:58 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Flow 'volume_create_manager' (7304f16e-1605-44d8-94ff-4459725d7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cc2b2c-4c1d-4cec-a6ab-58edf6cbe7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cc2b2c-4c1d-4cec-a6ab-58edf6cbe7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-522009588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69833b76-6159-427a-a40f-6bf5b2340de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e76f86842b462295dede87297be6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:59Z,use_quota=True,user_id='ace871f2b2dd4c6bb3b2bcaf0f84eb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea5950f-d9cc-411e-81a4-8b4bbb6dca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea5950f-d9cc-411e-81a4-8b4bbb6dca31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a60634-48b5-4b57-a452-cfd5e894f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a60634-48b5-4b57-a452-cfd5e894f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69833b76-6159-427a-a40f-6bf5b2340de6', 'volume_name': 'volume-69833b76-6159-427a-a40f-6bf5b2340de6', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76da551-8c45-43b7-b88a-2e98d29c794f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76da551-8c45-43b7-b88a-2e98d29c794f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5e54b0-42d1-4f35-a079-cfd1bef09479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Volume 69833b76-6159-427a-a40f-6bf5b2340de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69833b76-6159-427a-a40f-6bf5b2340de6', 'volume_size': 1} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:59 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.520s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:00:59 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Deleted volume successfully. Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-78758d41-1577-4b3c-8df8-7e3174c335c3 tempest-VolumesTransfersTest-170162216 None] Lock "cinder-ef25c111-c3e9-4abb-bd22-56fb51ed7d31-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:59 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174" returned: 0 in 0.637s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-0a36b06f-ce43-4885-a680-683b3905e174" released by "_copy_volume_from_snapshot" :: held 5.322s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-02ee0a23-568a-42d8-b807-493150c1a772-0a36b06f-ce43-4885-a680-683b3905e174" released by "_create_volume_from_snapshot" :: held 5.346s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.354s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5563ab1e-ff7a-4f49-9294-84daf684cc9b,created_at=2026-02-24T10:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-356877788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5563ab1e-ff7a-4f49-9294-84daf684cc9b,host='devstack@QuobyteHD#QuobyteHD',id=bfe831f0-bb9b-4147-a035-061a952289c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d7afac769b4e6c935c1ca2b142e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:56Z,use_quota=True,user_id='ee037e83f9f244ae914aff8a29c5a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(587cadca-ff55-40e5-b079-b51d0d44858d),volume_type_id=587cadca-ff55-40e5-b079-b51d0d44858d)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Creating volume bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:00:59 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:59 devstack sudo[85283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 1073741824 Feb 24 11:00:59 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4d9860-280f-44c6-8b72-dec54b217ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a36b06f-ce43-4885-a680-683b3905e174', 'volume_size': 1, 'snapshot_id': '02ee0a23-568a-42d8-b807-493150c1a772'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b756e09-1b22-4ddf-b1f4-5adc802da42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:00:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Volume volume-0a36b06f-ce43-4885-a680-683b3905e174 (0a36b06f-ce43-4885-a680-683b3905e174): created successfully Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b756e09-1b22-4ddf-b1f4-5adc802da42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Flow 'volume_create_manager' (4af9f0cf-07ad-4fe8-a63e-b45a8dad14f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:00:59 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7d24e8c7-380d-4292-8675-070046431eef tempest-VolumesDeleteCascade-2004058870 None] Created volume successfully. Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-19fe0f97-0049-4f24-943a-c1c33db3293f-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-19fe0f97-0049-4f24-943a-c1c33db3293f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:59 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Performing cascade delete. {{(pid=82627) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 1073741824" returned: 0 in 0.581s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-02ee0a23-568a-42d8-b807-493150c1a772-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-02ee0a23-568a-42d8-b807-493150c1a772-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-19fe0f97-0049-4f24-943a-c1c33db3293f" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-19fe0f97-0049-4f24-943a-c1c33db3293f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-02ee0a23-568a-42d8-b807-493150c1a772" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:00:59 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 Feb 24 11:00:59 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-02ee0a23-568a-42d8-b807-493150c1a772" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Deleting offline snapshot 02ee0a23-568a-42d8-b807-493150c1a772 of volume 19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] snapshot_file for this snap is: volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74028f8-d72c-4471-9e89-9b045de2e947]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:00:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:00:59 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 Feb 24 11:00:59 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:00 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3" returned: 0 in 0.465s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.257s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-522009588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69833b76-6159-427a-a40f-6bf5b2340de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e76f86842b462295dede87297be6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:00:59Z,use_quota=True,user_id='ace871f2b2dd4c6bb3b2bcaf0f84eb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Creating volume 69833b76-6159-427a-a40f-6bf5b2340de6 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:00 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e710873a-8192-41d1-8aca-15bb2c77fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe831f0-bb9b-4147-a035-061a952289c3', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e59ef00-bcfb-4030-a50d-05d0e9b43f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:00 devstack sudo[85296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 1073741824 Feb 24 11:01:00 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:00 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772" returned: 0 in 0.486s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19fe0f97-0049-4f24-943a-c1c33db3293f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:01:00 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Volume volume-bfe831f0-bb9b-4147-a035-061a952289c3 (bfe831f0-bb9b-4147-a035-061a952289c3): created successfully Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e59ef00-bcfb-4030-a50d-05d0e9b43f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Flow 'volume_create_manager' (e69cea08-95e5-4358-9d0e-9ba2fc9dac94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ccfeb9-61d8-49c7-a424-612c648be2df]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-15fc678a-cc24-4254-a97c-eab85c85391b tempest-GroupSnapshotsTest-1549686521 None] Created volume successfully. Feb 24 11:01:00 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f Feb 24 11:01:00 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:00 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 1073741824" returned: 0 in 0.478s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:00 devstack sudo[85306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 Feb 24 11:01:00 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:00 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f" returned: 0 in 0.489s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:00 devstack sudo[85308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 Feb 24 11:01:00 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] GroupSnapshot dc9eaf4d-fa08-4666-944b-a2ee2a1534a2: creating. Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Group snapshot dc9eaf4d-fa08-4666-944b-a2ee2a1534a2: creating. {{(pid=82627) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:01 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6" returned: 0 in 0.423s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.220s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Creating offline snapshot 30b2dde6-a27d-459b-8f2d-ac7805a5b23a of volume bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5e54b0-42d1-4f35-a079-cfd1bef09479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69833b76-6159-427a-a40f-6bf5b2340de6', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df38fd48-99a8-440c-b68c-6d4431352399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[afff3874-9033-4a9f-aaae-0b4f06482523]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:01 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Volume volume-69833b76-6159-427a-a40f-6bf5b2340de6 (69833b76-6159-427a-a40f-6bf5b2340de6): created successfully Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df38fd48-99a8-440c-b68c-6d4431352399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Flow 'volume_create_manager' (7304f16e-1605-44d8-94ff-4459725d7c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:01 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6bf0a6b0-7294-450d-a971-1231e4ee554f tempest-VolumesTransfersTest-424686276 None] Created volume successfully. Feb 24 11:01:01 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772" returned: 0 in 0.498s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:01 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 Feb 24 11:01:01 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:01 devstack sudo[85315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772 Feb 24 11:01:01 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:01 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f.02ee0a23-568a-42d8-b807-493150c1a772" returned: 0 in 0.480s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-02ee0a23-568a-42d8-b807-493150c1a772" released by "_delete_snapshot" :: held 2.017s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-19fe0f97-0049-4f24-943a-c1c33db3293f" released by "delete_snapshot" :: held 2.031s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:01 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3" returned: 0 in 0.673s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:01 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Created reservations ['394d76b7-ceb5-492b-b8d2-7db5997ed4b3', 'a09efab9-b60a-46e8-beaf-049ceedb5608', 'b7549f39-e559-4a37-8652-fe4241dab65c', 'a61699bf-d3f0-4091-a5b4-f7b97c7ae929'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:01 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a 1G Feb 24 11:01:01 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:02 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Delete snapshot completed successfully. Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-02ee0a23-568a-42d8-b807-493150c1a772-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Snapshots deleted, issuing volume delete {{(pid=82627) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-19fe0f97-0049-4f24-943a-c1c33db3293f" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-19fe0f97-0049-4f24-943a-c1c33db3293f" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[65699c99-5fc5-4322-a584-93f0e0775a0a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:02 devstack sudo[85351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f Feb 24 11:01:02 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Acquiring lock "cinder-69833b76-6159-427a-a40f-6bf5b2340de6-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Lock "cinder-69833b76-6159-427a-a40f-6bf5b2340de6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Acquiring lock "cinder-quobyte-69833b76-6159-427a-a40f-6bf5b2340de6" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Lock "cinder-quobyte-69833b76-6159-427a-a40f-6bf5b2340de6" acquired by "delete_volume" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9206cf2-a543-49f3-a870-0987d068e500]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:02 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 Feb 24 11:01:02 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:02 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f" returned: 0 in 0.797s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:02 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a 1G" returned: 0 in 0.994s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfe831f0-bb9b-4147-a035-061a952289c3 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:02 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f Feb 24 11:01:02 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:02 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfe831f0-bb9b-4147-a035-061a952289c3 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a Feb 24 11:01:02 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:03 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-19fe0f97-0049-4f24-943a-c1c33db3293f" returned: 0 in 0.463s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-19fe0f97-0049-4f24-943a-c1c33db3293f" released by "delete_volume" :: held 1.349s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:03 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6" returned: 0 in 0.928s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:03 devstack sudo[85373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6 Feb 24 11:01:03 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Created reservations ['354eeb14-c608-4c40-9482-6ae377f9e2a0', '9b62319a-c27a-475e-ba9c-cff3ad29396e', 'b5f9c7c8-3316-4fc7-8834-d2c5c3a5a080', '8c510d29-52ef-4e98-a803-aa3d6cbfef9d'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:03 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfe831f0-bb9b-4147-a035-061a952289c3 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a" returned: 0 in 0.591s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:03 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:03 devstack sudo[85375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:03 devstack sudo[85375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:03 devstack sudo[85377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a Feb 24 11:01:03 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:03 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a" returned: 0 in 0.430s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:03 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-69833b76-6159-427a-a40f-6bf5b2340de6" returned: 0 in 0.546s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:03 devstack sudo[85375]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Lock "cinder-quobyte-69833b76-6159-427a-a40f-6bf5b2340de6" released by "delete_volume" :: held 1.544s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.521s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:04 devstack sudo[85382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.info Feb 24 11:01:04 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:04 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Deleted volume successfully. Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Created reservations ['19d5ca92-59ff-4f90-8299-67ede2044c49', '40c007f9-9aa9-4806-8f57-662d71e11dab', '1aa0b113-2e69-4548-9f22-04aadaff2716', '0f54154f-6cdb-4182-a7d7-02514234e19f'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8d9ebd05-09c4-424f-9993-aa947ba6317e tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-19fe0f97-0049-4f24-943a-c1c33db3293f-delete_volume" released by "delete_volume" :: held 4.441s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:04 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:04 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-0a36b06f-ce43-4885-a680-683b3905e174-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-0a36b06f-ce43-4885-a680-683b3905e174-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "cinder-quobyte-0a36b06f-ce43-4885-a680-683b3905e174" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-0a36b06f-ce43-4885-a680-683b3905e174" acquired by "delete_volume" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9369209a-eb0b-4947-abfe-ce2aae96d9aa]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:04 devstack sudo[85410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 Feb 24 11:01:04 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:04 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.info" returned: 0 in 0.683s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:04 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.info is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:04 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.info Feb 24 11:01:04 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:04 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.666s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:04 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Deleted volume successfully. Feb 24 11:01:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-093c3758-039a-4204-a336-43626b1a4461 tempest-VolumesTransfersTest-170162216 None] Lock "cinder-69833b76-6159-427a-a40f-6bf5b2340de6-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:05 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174" returned: 0 in 0.534s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:05 devstack sudo[85419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174 Feb 24 11:01:05 devstack sudo[85419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:05 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.info" returned: 0 in 0.626s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.084s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:05 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9b32047c-e049-4f14-af00-669010afbf31 tempest-GroupSnapshotsTest-1549686521 None] group_snapshot dc9eaf4d-fa08-4666-944b-a2ee2a1534a2: created successfully Feb 24 11:01:05 devstack sudo[85419]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a36b06f-ce43-4885-a680-683b3905e174" returned: 0 in 0.484s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-quobyte-0a36b06f-ce43-4885-a680-683b3905e174" released by "delete_volume" :: held 1.083s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Created reservations ['a9912638-f280-4f53-8ce9-f12dd28942e2', 'd9b9a901-b0c6-4822-86d3-89a1b16447e3', 'bf0c2e6a-c3e1-4f39-aa35-994fd82cd700', 'c29c7e11-132e-4cbb-a212-743763c1ced5'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:05 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:05 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:06 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.516s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:06 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:06 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Deleted volume successfully. Feb 24 11:01:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39ec10e4-272e-477a-8744-ce9be5318089 tempest-VolumesDeleteCascade-2004058870 None] Lock "cinder-0a36b06f-ce43-4885-a680-683b3905e174-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.014s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-30b2dde6-a27d-459b-8f2d-ac7805a5b23a-42326a3e-373e-4221-8d96-83a1ce8b6384" by "_create_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-30b2dde6-a27d-459b-8f2d-ac7805a5b23a-42326a3e-373e-4221-8d96-83a1ce8b6384" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Creating volume 42326a3e-373e-4221-8d96-83a1ce8b6384 from snapshot 30b2dde6-a27d-459b-8f2d-ac7805a5b23a {{(pid=82627) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-42326a3e-373e-4221-8d96-83a1ce8b6384" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-42326a3e-373e-4221-8d96-83a1ce8b6384" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] snapshot: 30b2dde6-a27d-459b-8f2d-ac7805a5b23a, volume: 42326a3e-373e-4221-8d96-83a1ce8b6384, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dca0f5-605f-4d77-8675-6c73b2b1c775]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:07 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a Feb 24 11:01:07 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:08 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a" returned: 0 in 0.635s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfe831f0-bb9b-4147-a035-061a952289c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bfb89c-78dd-4cbb-b678-ebca41452d8e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:08 devstack sudo[85481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 Feb 24 11:01:08 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:08 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3" returned: 0 in 0.670s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:01:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:08 devstack sudo[85489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 Feb 24 11:01:08 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Flow 'volume_create_manager' (b678d302-9d63-48c7-b3cc-3a3c36eec832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fc1332-0df4-4084-86a5-0ddacc1e557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fc1332-0df4-4084-86a5-0ddacc1e557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1610636798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17f82a2c20f4da3b4d1df31ceb3da70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:09Z,use_quota=True,user_id='e24e73d56c0849ffbaf498f905f58842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998c3418-d854-404d-b09e-f86b5b8348a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998c3418-d854-404d-b09e-f86b5b8348a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f7af48-1181-46e1-bbf2-74ff44285d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f7af48-1181-46e1-bbf2-74ff44285d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6', 'volume_name': 'volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6', 'volume_size': 2}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8717e48-d7c4-48ee-945a-c15d95d70f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8717e48-d7c4-48ee-945a-c15d95d70f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1a8f65-8d3c-407b-86fc-9367e9405acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Volume 31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6', 'volume_size': 2} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Flow 'volume_create_manager' (60311801-ffa4-4570-8c19-fa8c4b896796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d002ef5-fc3d-4b8b-8dc4-607ed370e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d002ef5-fc3d-4b8b-8dc4-607ed370e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1335881982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f354bc1-25f8-4ea3-92ca-80b90ee68a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264a3b8c2445028ed6a518ee4f0cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:10Z,use_quota=True,user_id='b1b30d1d346841cca674b0ab55176c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab731b9-9860-41b6-ba52-7d7d47c21dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab731b9-9860-41b6-ba52-7d7d47c21dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66268fb4-1536-4f88-8025-e3c509eea90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66268fb4-1536-4f88-8025-e3c509eea90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f354bc1-25f8-4ea3-92ca-80b90ee68a84', 'volume_name': 'volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf098a9-5e84-4bfc-ad88-48958ea6af90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf098a9-5e84-4bfc-ad88-48958ea6af90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bca1ead-eb62-4eb8-84e9-0f29f0a3e08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:09 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Volume 7f354bc1-25f8-4ea3-92ca-80b90ee68a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84', 'volume_size': 1} Feb 24 11:01:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:11 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384" returned: 0 in 2.241s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecf7cb3-cdcf-4cf5-87a6-6189950b0442]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:11 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 Feb 24 11:01:11 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:11 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3" returned: 0 in 0.615s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:11 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:01:11 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Converted 1024.00 MB image at 456.75 MB/s Feb 24 11:01:11 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:01:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:11 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 Feb 24 11:01:11 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:12 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384" returned: 0 in 0.394s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-42326a3e-373e-4221-8d96-83a1ce8b6384" released by "_copy_volume_from_snapshot" :: held 4.630s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-30b2dde6-a27d-459b-8f2d-ac7805a5b23a-42326a3e-373e-4221-8d96-83a1ce8b6384" released by "_create_volume_from_snapshot" :: held 4.650s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.676s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1610636798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17f82a2c20f4da3b4d1df31ceb3da70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:09Z,use_quota=True,user_id='e24e73d56c0849ffbaf498f905f58842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Creating volume 31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:12 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 2147483648 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=141,cinder:INSERT=41,cinder:UPDATE=164,cinder:DELETE=15 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:01:12 devstack sudo[85510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 2147483648 Feb 24 11:01:12 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:12 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e6a0b18e-ad64-4b49-bc07-3537beb70f7c tempest-GroupSnapshotsTest-1549686521 None] Create group from source-snapshot-dc9eaf4d-fa08-4666-944b-a2ee2a1534a2 completed successfully. Feb 24 11:01:12 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 2147483648" returned: 0 in 0.493s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:12 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 Feb 24 11:01:12 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:13 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6" returned: 0 in 0.401s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.384s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1335881982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f354bc1-25f8-4ea3-92ca-80b90ee68a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264a3b8c2445028ed6a518ee4f0cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:10Z,use_quota=True,user_id='b1b30d1d346841cca674b0ab55176c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Creating volume 7f354bc1-25f8-4ea3-92ca-80b90ee68a84 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:13 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=150,cinder:INSERT=42,cinder:UPDATE=194,cinder:DELETE=14 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1a8f65-8d3c-407b-86fc-9367e9405acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6', 'volume_size': 2}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:13 devstack sudo[85518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 1073741824 Feb 24 11:01:13 devstack sudo[85518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b56c573-eed0-45b3-a53a-c2bd81516d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:13 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Volume volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 (31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6): created successfully Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b56c573-eed0-45b3-a53a-c2bd81516d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Flow 'volume_create_manager' (b678d302-9d63-48c7-b3cc-3a3c36eec832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9facd4ce-e2f5-46fc-89f7-545bf34f70cb tempest-VolumesCloneNegativeTest-612109563 None] Created volume successfully. Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-42326a3e-373e-4221-8d96-83a1ce8b6384" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-42326a3e-373e-4221-8d96-83a1ce8b6384" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc73c0f3-d086-47ac-be5a-061b7fada261]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:13 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 Feb 24 11:01:13 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:13 devstack sudo[85518]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 1073741824" returned: 0 in 0.634s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:13 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 Feb 24 11:01:13 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Acquiring lock "cinder-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Lock "cinder-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Acquiring lock "cinder-quobyte-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Lock "cinder-quobyte-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ede9045-4750-4c9c-bc0c-9a22886a6359]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:14 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384" returned: 0 in 0.609s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:14 devstack sudo[85527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 Feb 24 11:01:14 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:14 devstack sudo[85532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384 Feb 24 11:01:14 devstack sudo[85532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:14 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84" returned: 0 in 0.511s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bca1ead-eb62-4eb8-84e9-0f29f0a3e08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bae74e8-7c07-4130-8eaa-9aa01212b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:14 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Volume volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 (7f354bc1-25f8-4ea3-92ca-80b90ee68a84): created successfully Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bae74e8-7c07-4130-8eaa-9aa01212b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Flow 'volume_create_manager' (60311801-ffa4-4570-8c19-fa8c4b896796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:14 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-1ee0fcb8-a1a9-41dd-97cf-155809930027 tempest-VolumesMetadataTest-904760681 None] Created volume successfully. Feb 24 11:01:14 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6" returned: 0 in 0.699s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:14 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6 Feb 24 11:01:14 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:14 devstack sudo[85532]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-42326a3e-373e-4221-8d96-83a1ce8b6384" returned: 0 in 0.560s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-42326a3e-373e-4221-8d96-83a1ce8b6384" released by "delete_volume" :: held 1.203s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['40bcc51b-b37b-434c-a078-38d3d4b6b3c9'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:14 devstack cinder-volume[82627]: WARNING cinder.quota [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1328380331 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1328380331, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:01:14 devstack cinder-volume[82627]: WARNING cinder.quota [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1328380331 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1328380331, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['b28356d6-fad7-4220-bdad-044bd6a86624', '5d48bb05-9e25-427a-8d13-6edee888aab1', '34d6533b-da16-4f8d-b03b-5bc415ac9436', '836b1aac-3355-4af6-a584-91ff13355e44'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:14 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:14 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:15 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6" returned: 0 in 0.420s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Lock "cinder-quobyte-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6" released by "delete_volume" :: held 1.145s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Created reservations ['2e14b498-4454-4cbd-8044-70b792796f80', '9a1eea96-325a-4b29-8fe0-ee1c074dfe3c', '2fc5a3e7-9bc0-4608-9db1-ce64786405d7', '9cb83852-5ed4-4853-a59b-1a8786b2863f'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:15 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:15 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Acquiring lock "cinder-7f354bc1-25f8-4ea3-92ca-80b90ee68a84-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Lock "cinder-7f354bc1-25f8-4ea3-92ca-80b90ee68a84-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Acquiring lock "cinder-quobyte-7f354bc1-25f8-4ea3-92ca-80b90ee68a84" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Lock "cinder-quobyte-7f354bc1-25f8-4ea3-92ca-80b90ee68a84" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da64821-e85a-4af8-8606-770209e522ed]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:15 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.591s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-2def6d35-296d-4eff-b3d2-f9004e96d480 tempest-GroupSnapshotsTest-1549686521 None] Delete group completed successfully. Feb 24 11:01:15 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 Feb 24 11:01:15 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] group_snapshot dc9eaf4d-fa08-4666-944b-a2ee2a1534a2: deleting Feb 24 11:01:15 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.569s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] group_snapshot dc9eaf4d-fa08-4666-944b-a2ee2a1534a2: deleting {{(pid=82627) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 24 11:01:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Deleted volume successfully. Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-bfe831f0-bb9b-4147-a035-061a952289c3" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-42292df3-026f-4491-9eee-80f28a10cdb4 tempest-VolumesCloneNegativeTest-612109563 None] Lock "cinder-31e2b2f0-75d5-4bdf-94ad-97c22d0d3fd6-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-bfe831f0-bb9b-4147-a035-061a952289c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-30b2dde6-a27d-459b-8f2d-ac7805a5b23a" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-30b2dde6-a27d-459b-8f2d-ac7805a5b23a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Deleting offline snapshot 30b2dde6-a27d-459b-8f2d-ac7805a5b23a of volume bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] snapshot_file for this snap is: volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee5d16f-c653-4e43-9d06-a72b78242537]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:15 devstack sudo[85566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a Feb 24 11:01:15 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:15 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84" returned: 0 in 0.588s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:16 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84 Feb 24 11:01:16 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:16 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a" returned: 0 in 0.547s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfe831f0-bb9b-4147-a035-061a952289c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:01:16 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7f354bc1-25f8-4ea3-92ca-80b90ee68a84" returned: 0 in 0.435s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3e685a-c5a2-4c87-b3bc-df4b9cf9bcd8]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Lock "cinder-quobyte-7f354bc1-25f8-4ea3-92ca-80b90ee68a84" released by "delete_volume" :: held 1.075s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Created reservations ['fe4843d5-54b0-4bd2-864f-42a6d877b065', 'b7d7f89a-44eb-43ae-9ca6-28c81dff8679', 'ced43855-8b71-4aa9-bbf9-501b8a37d563', 'a7336696-6faf-4e56-a282-4d7c28614599'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:16 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:16 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:16 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 Feb 24 11:01:16 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:17 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3" returned: 0 in 0.632s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:17 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a Feb 24 11:01:17 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:17 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.540s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:17 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:17 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Deleted volume successfully. Feb 24 11:01:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a6a6aeb5-0950-4f06-8824-98e358d519a1 tempest-VolumesMetadataTest-904760681 None] Lock "cinder-7f354bc1-25f8-4ea3-92ca-80b90ee68a84-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:17 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a" returned: 0 in 0.483s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:17 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a Feb 24 11:01:17 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:18 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3.30b2dde6-a27d-459b-8f2d-ac7805a5b23a" returned: 0 in 0.463s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-30b2dde6-a27d-459b-8f2d-ac7805a5b23a" released by "_delete_snapshot" :: held 2.229s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-bfe831f0-bb9b-4147-a035-061a952289c3" released by "delete_snapshot" :: held 2.252s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:18 devstack cinder-volume[82627]: WARNING cinder.quota [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1328380331 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1328380331, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['e9f74b8a-944a-4f72-b0df-70113b7f4620', '87847d91-4fe7-45f0-aa32-cb8a9c5cfcdf', 'b6f37d14-f65a-4938-8053-fa9523f13259', '81ce56bb-a69a-4428-911c-58bcd041369b'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:18 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-18b47124-530c-4f65-984f-e7251bef07ed tempest-GroupSnapshotsTest-1549686521 None] group_snapshot dc9eaf4d-fa08-4666-944b-a2ee2a1534a2: deleted successfully Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Flow 'volume_create_manager' (a46ea4c6-afe1-42d7-a506-2782a74b8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494056e1-0867-4bfa-8795-e6adddcb5508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494056e1-0867-4bfa-8795-e6adddcb5508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-976690765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71640550-684b-46b9-95e2-8b43ca05d1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f1acbc8c4486c8429df966d4647ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:18Z,use_quota=True,user_id='0ccec8f3c7014179a6012806b572abf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bf06fe-0f64-4614-a02a-1be30d4045c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bf06fe-0f64-4614-a02a-1be30d4045c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84100e93-b6c2-4590-9093-ee4b8fffada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.image.glance [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Creating Keystone auth plugin from conf {{(pid=82627) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84100e93-b6c2-4590-9093-ee4b8fffada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71640550-684b-46b9-95e2-8b43ca05d1c5', 'volume_name': 'volume-71640550-684b-46b9-95e2-8b43ca05d1c5', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8fb1fb-df14-474e-b811-44220246c5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8fb1fb-df14-474e-b811-44220246c5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8a357e-9ba8-480d-a06e-e9f387833274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:18 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Volume 71640550-684b-46b9-95e2-8b43ca05d1c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71640550-684b-46b9-95e2-8b43ca05d1c5', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 24 11:01:18 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Trying to clone 71640550-684b-46b9-95e2-8b43ca05d1c5 from image 4158f967-877e-452e-b5d3-debeeb743c37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]). {{(pid=82627) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 24 11:01:19 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 24 11:01:19 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Image download 20.69 MB at 20.69 MB/s Feb 24 11:01:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-bfe831f0-bb9b-4147-a035-061a952289c3" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-bfe831f0-bb9b-4147-a035-061a952289c3" acquired by "delete_volume" :: waited 0.026s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:19 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9b6148-a843-437f-9a65-8c2c1c30d702]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:19 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b732b7-a1b0-4d46-b480-0cf10fff7e43]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:19 devstack sudo[85628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 Feb 24 11:01:19 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:19 devstack sudo[85627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD Feb 24 11:01:19 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:20 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD" returned: 0 in 0.916s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 is fetched for user 0ccec8f3c7014179a6012806b572abf2. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 24 11:01:20 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3" returned: 0 in 0.980s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60ee466-5e1f-4876-b474-2ee1d2ae23dc]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:20 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3 Feb 24 11:01:20 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:20 devstack sudo[85664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD Feb 24 11:01:20 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:20 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD" returned: 0 in 0.761s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-976690765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71640550-684b-46b9-95e2-8b43ca05d1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f1acbc8c4486c8429df966d4647ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:18Z,use_quota=True,user_id='0ccec8f3c7014179a6012806b572abf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Creating volume 71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:20 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:21 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 1073741824 Feb 24 11:01:21 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:21 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bfe831f0-bb9b-4147-a035-061a952289c3" returned: 0 in 0.857s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-bfe831f0-bb9b-4147-a035-061a952289c3" released by "delete_volume" :: held 1.895s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['b161ad11-1c48-4f46-a1e5-27adf47eb984'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:21 devstack cinder-volume[82627]: WARNING cinder.db.sqlalchemy.api [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1328380331'] Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['58ff5248-68f2-49ac-b08c-186b5fc492d5', 'e17fd88f-ee48-4f8b-bb64-06e7e30a81a8', '48e01408-c6b0-4a7d-9cd2-01700b2dbb4b', '37ec5363-0947-4ba7-bb38-cf2f227d6122'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:21 devstack sudo[85674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:21 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:21 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 1073741824" returned: 0 in 0.705s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:21 devstack sudo[85679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:21 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0c58844d-1702-48a8-8b66-f5ff225bd3dd tempest-GroupSnapshotsTest-1549686521 None] Group tempest-GroupSnapshotsTest-Group-1448491050: creating Feb 24 11:01:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0c58844d-1702-48a8-8b66-f5ff225bd3dd tempest-GroupSnapshotsTest-1549686521 None] Group tempest-GroupSnapshotsTest-Group-1448491050: created successfully Feb 24 11:01:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0c58844d-1702-48a8-8b66-f5ff225bd3dd tempest-GroupSnapshotsTest-1549686521 None] Create group completed successfully. Feb 24 11:01:22 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.751s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:22 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:22 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-234f7ffe-1844-4572-902b-509431a020b4 tempest-GroupSnapshotsTest-1549686521 None] Delete group completed successfully. Feb 24 11:01:22 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 0 in 0.512s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:22 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Attempting download of 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume 71640550-684b-46b9-95e2-8b43ca05d1c5. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 24 11:01:22 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0e9422-f365-4e71-bfbb-317170c2a15d]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_w5b4fl34 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:22 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_w5b4fl34 Feb 24 11:01:22 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:23 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_w5b4fl34" returned: 0 in 0.754s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_w5b4fl34 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:23 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_w5b4fl34 Feb 24 11:01:23 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Flow 'volume_create_manager' (1fcef26c-35c7-4997-a4e7-f67ea94bde6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c277a607-f411-437e-86d9-944f85f7f797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c277a607-f411-437e-86d9-944f85f7f797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-337460212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30f06d14-37de-4f50-a47a-4c16519d06d4,host='devstack@QuobyteHD#QuobyteHD',id=5c2d23b6-3a04-4d86-a307-0c36173befbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d7afac769b4e6c935c1ca2b142e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:23Z,use_quota=True,user_id='ee037e83f9f244ae914aff8a29c5a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0527f99-0c56-4a1f-8841-50d7290572a9),volume_type_id=d0527f99-0c56-4a1f-8841-50d7290572a9)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f248fe8d-bdc8-4d0e-9e95-b6c571a2e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f248fe8d-bdc8-4d0e-9e95-b6c571a2e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb2593c-c655-4a63-8d16-af1d30d64816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb2593c-c655-4a63-8d16-af1d30d64816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2d23b6-3a04-4d86-a307-0c36173befbe', 'volume_name': 'volume-5c2d23b6-3a04-4d86-a307-0c36173befbe', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387c559e-f89b-4788-b401-e9248e56f47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387c559e-f89b-4788-b401-e9248e56f47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac742e7b-9992-497c-b6de-2a3afd3fac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:23 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Volume 5c2d23b6-3a04-4d86-a307-0c36173befbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2d23b6-3a04-4d86-a307-0c36173befbe', 'volume_size': 1} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=30f06d14-37de-4f50-a47a-4c16519d06d4,created_at=2026-02-24T10:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-337460212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30f06d14-37de-4f50-a47a-4c16519d06d4,host='devstack@QuobyteHD#QuobyteHD',id=5c2d23b6-3a04-4d86-a307-0c36173befbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d7afac769b4e6c935c1ca2b142e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:23Z,use_quota=True,user_id='ee037e83f9f244ae914aff8a29c5a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0527f99-0c56-4a1f-8841-50d7290572a9),volume_type_id=d0527f99-0c56-4a1f-8841-50d7290572a9)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Creating volume 5c2d23b6-3a04-4d86-a307-0c36173befbe {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:23 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:23 devstack sudo[85689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe 1073741824 Feb 24 11:01:23 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:23 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_w5b4fl34" returned: 1 in 0.526s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_w5b4fl34' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[25015fd4-b335-431d-a519-884dea1904a7]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:23 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD Feb 24 11:01:23 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:24 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe 1073741824" returned: 0 in 0.543s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:24 devstack sudo[85698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe Feb 24 11:01:24 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:24 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD" returned: 0 in 0.742s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:24 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] 4158f967-877e-452e-b5d3-debeeb743c37 was qcow2, converting to raw {{(pid=82627) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 24 11:01:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:24 devstack sudo[85703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:24 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:24 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe" returned: 0 in 0.955s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac742e7b-9992-497c-b6de-2a3afd3fac33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2d23b6-3a04-4d86-a307-0c36173befbe', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c93c1e-8f74-4005-ad50-5c60508cf562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:25 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Volume volume-5c2d23b6-3a04-4d86-a307-0c36173befbe (5c2d23b6-3a04-4d86-a307-0c36173befbe): created successfully Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c93c1e-8f74-4005-ad50-5c60508cf562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Flow 'volume_create_manager' (1fcef26c-35c7-4997-a4e7-f67ea94bde6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:25 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-32e08d59-5a42-427b-b6e1-445fe2b1ebea tempest-GroupSnapshotsTest-1549686521 None] Created volume successfully. Feb 24 11:01:25 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 0 in 1.416s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_oata2g70devstack@QuobyteHD, size 112.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:01:25 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Converted 112.00 MB image at 79.05 MB/s Feb 24 11:01:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:25 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 1G Feb 24 11:01:25 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Flow 'volume_create_manager' (7baa0fe0-0f85-4d4d-bd2a-4cd8b56b66f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c8b695-8938-442c-b12f-fe347d1353a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c8b695-8938-442c-b12f-fe347d1353a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-896286534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30f06d14-37de-4f50-a47a-4c16519d06d4,host='devstack@QuobyteHD#QuobyteHD',id=97112f79-e253-469e-83d5-fc73ed0b88b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d7afac769b4e6c935c1ca2b142e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:26Z,use_quota=True,user_id='ee037e83f9f244ae914aff8a29c5a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0527f99-0c56-4a1f-8841-50d7290572a9),volume_type_id=d0527f99-0c56-4a1f-8841-50d7290572a9)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7115ac-1777-492d-93e1-fba5a506bd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7115ac-1777-492d-93e1-fba5a506bd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5aaa73-e72a-4951-a53a-10921fdb8142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5aaa73-e72a-4951-a53a-10921fdb8142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97112f79-e253-469e-83d5-fc73ed0b88b6', 'volume_name': 'volume-97112f79-e253-469e-83d5-fc73ed0b88b6', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8d2f81-81e7-4960-8eb0-6653a80b7059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8d2f81-81e7-4960-8eb0-6653a80b7059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b820078b-5bf2-4c4d-b0ea-47d45de5e5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:26 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Volume 97112f79-e253-469e-83d5-fc73ed0b88b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97112f79-e253-469e-83d5-fc73ed0b88b6', 'volume_size': 1} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=30f06d14-37de-4f50-a47a-4c16519d06d4,created_at=2026-02-24T10:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-896286534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30f06d14-37de-4f50-a47a-4c16519d06d4,host='devstack@QuobyteHD#QuobyteHD',id=97112f79-e253-469e-83d5-fc73ed0b88b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d7afac769b4e6c935c1ca2b142e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:26Z,use_quota=True,user_id='ee037e83f9f244ae914aff8a29c5a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0527f99-0c56-4a1f-8841-50d7290572a9),volume_type_id=d0527f99-0c56-4a1f-8841-50d7290572a9)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Creating volume 97112f79-e253-469e-83d5-fc73ed0b88b6 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:26 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:26 devstack sudo[85724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 1073741824 Feb 24 11:01:26 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:26 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 1G" returned: 0 in 0.890s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6cfa46-287c-4e58-99d3-aab0637dbf57]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:26 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:26 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:27 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 1073741824" returned: 0 in 0.984s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:27 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 Feb 24 11:01:27 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:27 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 0 in 0.888s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:27 devstack sudo[85768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:27 devstack sudo[85768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:28 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6" returned: 0 in 1.028s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b820078b-5bf2-4c4d-b0ea-47d45de5e5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97112f79-e253-469e-83d5-fc73ed0b88b6', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3511a4-c442-4d2d-9962-0abf37213b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:28 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Volume volume-97112f79-e253-469e-83d5-fc73ed0b88b6 (97112f79-e253-469e-83d5-fc73ed0b88b6): created successfully Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3511a4-c442-4d2d-9962-0abf37213b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Flow 'volume_create_manager' (7baa0fe0-0f85-4d4d-bd2a-4cd8b56b66f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:28 devstack sudo[85768]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 1 in 0.934s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Downloaded image 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume 71640550-684b-46b9-95e2-8b43ca05d1c5 successfully. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 for user 0ccec8f3c7014179a6012806b572abf2 is deleted. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Marking volume 71640550-684b-46b9-95e2-8b43ca05d1c5 as bootable. {{(pid=82627) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 24 11:01:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c5e5d568-9644-4d2b-85f5-14043ce63dd4 tempest-GroupSnapshotsTest-1549686521 None] Created volume successfully. Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Copying metadata from image 4158f967-877e-452e-b5d3-debeeb743c37 to 71640550-684b-46b9-95e2-8b43ca05d1c5. {{(pid=82627) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Creating volume glance metadata for volume 71640550-684b-46b9-95e2-8b43ca05d1c5 backed by image 4158f967-877e-452e-b5d3-debeeb743c37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82627) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8a357e-9ba8-480d-a06e-e9f387833274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71640550-684b-46b9-95e2-8b43ca05d1c5', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3711ae3-c26b-45eb-a646-17d25ba6698d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:28 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Volume volume-71640550-684b-46b9-95e2-8b43ca05d1c5 (71640550-684b-46b9-95e2-8b43ca05d1c5): created successfully Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3711ae3-c26b-45eb-a646-17d25ba6698d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Flow 'volume_create_manager' (a46ea4c6-afe1-42d7-a506-2782a74b8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3374f8b7-f102-425a-bd72-f4f348dda2d3 tempest-VolumesExtendTest-6593106 None] Created volume successfully. Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Flow 'volume_create_manager' (8e9e783b-89d5-4992-8aa3-e069726d0a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913cbb98-7c74-4d5a-a9b8-39d14ded1511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913cbb98-7c74-4d5a-a9b8-39d14ded1511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-199010818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c5fcff-aa9d-4144-ae4e-978afec9ef9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d3c110718a4a3ca50e9c335a88c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:29Z,use_quota=True,user_id='384d93c8fbe043deb348a1358c16fdfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cc48cf-f076-453a-8676-4d4000d8d020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cc48cf-f076-453a-8676-4d4000d8d020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffca699-eacb-4f74-b329-9acd34f80ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffca699-eacb-4f74-b329-9acd34f80ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c5fcff-aa9d-4144-ae4e-978afec9ef9a', 'volume_name': 'volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9fb783-bee4-42ea-b186-eb59dcfa1073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9fb783-bee4-42ea-b186-eb59dcfa1073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fa654e-7a54-460d-97c2-487e5122c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:28 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Volume 99c5fcff-aa9d-4144-ae4e-978afec9ef9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a', 'volume_size': 1} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-199010818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c5fcff-aa9d-4144-ae4e-978afec9ef9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d3c110718a4a3ca50e9c335a88c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:29Z,use_quota=True,user_id='384d93c8fbe043deb348a1358c16fdfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Creating volume 99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:28 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:29 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a 1073741824 Feb 24 11:01:29 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:29 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-fa4c4273-9b55-4391-8187-95bf65558d50 tempest-GroupSnapshotsTest-1549686521 None] Update group completed successfully. Feb 24 11:01:29 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a 1073741824" returned: 0 in 0.853s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:29 devstack sudo[85791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:01:29 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:30 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.424s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.846s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fa654e-7a54-460d-97c2-487e5122c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57a9f00-5004-4cf5-bd01-3ae84b133ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:30 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Volume volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a (99c5fcff-aa9d-4144-ae4e-978afec9ef9a): created successfully Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57a9f00-5004-4cf5-bd01-3ae84b133ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Flow 'volume_create_manager' (8e9e783b-89d5-4992-8aa3-e069726d0a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8837fd3-c9b7-4bdb-b442-cac77b2c99b4]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:30 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a90badc4-df86-4f4d-9e95-927aeea05f2b tempest-VolumesActionsTest-1516436239 None] Created volume successfully. Feb 24 11:01:30 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:30 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:30 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-22a03ccc-1088-4618-90f0-6d9919030464 tempest-GroupSnapshotsTest-1549686521 None] Update group completed successfully. Feb 24 11:01:30 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 0 in 0.599s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:31 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:31 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:31 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 1 in 0.549s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 2G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 2G" returned: 0 in 0.059s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.241s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:31 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-1345010d-0cdf-43de-b906-29fc48b68d7b tempest-VolumesExtendTest-6593106 None] Extend volume completed successfully. Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Acquiring lock "cinder-71640550-684b-46b9-95e2-8b43ca05d1c5-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Lock "cinder-71640550-684b-46b9-95e2-8b43ca05d1c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Acquiring lock "cinder-quobyte-71640550-684b-46b9-95e2-8b43ca05d1c5" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Lock "cinder-quobyte-71640550-684b-46b9-95e2-8b43ca05d1c5" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:32 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[99367b80-0277-41a5-ae04-0c307e0f052f]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:32 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f23a2f02-fd1d-4f24-9f12-c4585ece45bb tempest-GroupSnapshotsTest-1549686521 None] Update group completed successfully. Feb 24 11:01:32 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:32 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:32 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 0 in 0.576s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:32 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:32 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-62336a76-5366-4d62-a5eb-c67b6a7ad9ef tempest-GroupSnapshotsTest-1549686521 None] Update group completed successfully. Feb 24 11:01:33 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 1 in 0.720s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:33 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5 Feb 24 11:01:33 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:33 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-71640550-684b-46b9-95e2-8b43ca05d1c5" returned: 0 in 0.454s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Lock "cinder-quobyte-71640550-684b-46b9-95e2-8b43ca05d1c5" released by "delete_volume" :: held 1.859s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Created reservations ['db04e3fa-497e-44da-a141-0c5b6c1452b6', '3b66b1a0-74cf-4f8f-b421-90067924d116', '5891868b-bd52-4d8d-9dfd-951fd285961c', 'b4d24839-0f33-4319-9914-6da54a425d37'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:33 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:33 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:34 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:34 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Flow 'volume_create_manager' (268db540-0e63-4ec3-a77f-e48ddda4d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddd699c-841a-447a-b503-1daccea8ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:34 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] GroupSnapshot 2916c75a-95f2-403e-a0d1-5f6e12327aa0: creating. Feb 24 11:01:34 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddd699c-841a-447a-b503-1daccea8ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-539076697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd232719-dbc2-4a47-86a8-6956d20159e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f1acbc8c4486c8429df966d4647ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:35Z,use_quota=True,user_id='0ccec8f3c7014179a6012806b572abf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d55623-895c-4219-8af4-968fe64f4e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d55623-895c-4219-8af4-968fe64f4e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c871fc-6ade-4597-9e9f-dff6b5ada9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c871fc-6ade-4597-9e9f-dff6b5ada9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd232719-dbc2-4a47-86a8-6956d20159e4', 'volume_name': 'volume-dd232719-dbc2-4a47-86a8-6956d20159e4', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397b1fb2-16e1-45c9-a8b9-888aed16c0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397b1fb2-16e1-45c9-a8b9-888aed16c0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363263e7-4f53-4306-b99e-ff6f681999a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:34 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Volume dd232719-dbc2-4a47-86a8-6956d20159e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd232719-dbc2-4a47-86a8-6956d20159e4', 'volume_size': 1} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-539076697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd232719-dbc2-4a47-86a8-6956d20159e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f1acbc8c4486c8429df966d4647ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:35Z,use_quota=True,user_id='0ccec8f3c7014179a6012806b572abf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Creating volume dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:34 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.744s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:34 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 1073741824 Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:34 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.886s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Group snapshot 2916c75a-95f2-403e-a0d1-5f6e12327aa0: creating. {{(pid=82627) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Deleted volume successfully. Feb 24 11:01:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cf62613d-2997-499d-998e-09a5213a61e9 tempest-VolumesExtendTest-6593106 None] Lock "cinder-71640550-684b-46b9-95e2-8b43ca05d1c5-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:35 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 1073741824" returned: 0 in 0.611s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:35 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 Feb 24 11:01:35 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:35 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4" returned: 0 in 0.443s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.034s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Creating offline snapshot 6af7b8c2-4e11-498c-ba75-bb60c5c036cb of volume 97112f79-e253-469e-83d5-fc73ed0b88b6 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363263e7-4f53-4306-b99e-ff6f681999a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd232719-dbc2-4a47-86a8-6956d20159e4', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f055da-7f52-4889-93d6-a1f032d27c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7b1b8e-abee-4c42-ae63-328d0210d909]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:35 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Volume volume-dd232719-dbc2-4a47-86a8-6956d20159e4 (dd232719-dbc2-4a47-86a8-6956d20159e4): created successfully Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f055da-7f52-4889-93d6-a1f032d27c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Flow 'volume_create_manager' (268db540-0e63-4ec3-a77f-e48ddda4d66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:35 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-08f32d6f-d728-4187-8973-3df3349e94be tempest-VolumesExtendTest-6593106 None] Created volume successfully. Feb 24 11:01:35 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 Feb 24 11:01:35 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:36 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6" returned: 0 in 0.548s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:36 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb 1G Feb 24 11:01:36 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:37 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb 1G" returned: 0 in 0.868s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97112f79-e253-469e-83d5-fc73ed0b88b6 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:37 devstack sudo[85850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97112f79-e253-469e-83d5-fc73ed0b88b6 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb Feb 24 11:01:37 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:38 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97112f79-e253-469e-83d5-fc73ed0b88b6 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb" returned: 0 in 0.777s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:38 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:38 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:38 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Flow 'volume_create_manager' (aa54e532-3ba1-40c1-9c48-70918988d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec97169-3bcd-4ae5-89a0-58b8409892a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec97169-3bcd-4ae5-89a0-58b8409892a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30d7a0a-afc5-478b-bacb-f5c15cfee5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9196d1155245b7ac6a66607abf84d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:38Z,use_quota=True,user_id='1a135edf51ef476d8e593ad39b30a086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30494e36-4a0e-4f7b-ad03-65955e5109e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30494e36-4a0e-4f7b-ad03-65955e5109e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5537d076-ebde-40e7-8774-26a7f85c3b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.image.glance [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Creating Keystone auth plugin from conf {{(pid=82627) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5537d076-ebde-40e7-8774-26a7f85c3b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a30d7a0a-afc5-478b-bacb-f5c15cfee5ea', 'volume_name': 'volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fa6c8d-e4a0-435b-8f4e-5aef89708f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fa6c8d-e4a0-435b-8f4e-5aef89708f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd254b51-fdd2-4819-b75e-f52f92c1563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:38 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Volume a30d7a0a-afc5-478b-bacb-f5c15cfee5ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Trying to clone a30d7a0a-afc5-478b-bacb-f5c15cfee5ea from image 4158f967-877e-452e-b5d3-debeeb743c37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]). {{(pid=82627) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 24 11:01:38 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb" returned: 0 in 0.733s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 24 11:01:38 devstack cinder-volume[82627]: INFO cinder.image.image_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Image download 20.69 MB at 20.69 MB/s Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[052d23ae-b7e4-4c94-bbd2-19163652f0bf]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:38 devstack sudo[85863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.info Feb 24 11:01:38 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:39 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD Feb 24 11:01:39 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:39 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.info" returned: 0 in 0.597s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:39 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.info is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:01:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:39 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.info Feb 24 11:01:39 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:39 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD" returned: 0 in 0.666s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:39 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 is fetched for user 1a135edf51ef476d8e593ad39b30a086. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 24 11:01:39 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc691d63-d0b7-445a-81a1-dc618a353821]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:39 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD Feb 24 11:01:39 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:40 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.info" returned: 0 in 0.644s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Creating offline snapshot e03fe66a-deb7-469e-a5bf-8ff457290298 of volume 5c2d23b6-3a04-4d86-a307-0c36173befbe {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[756fc20b-38d3-4ce0-b5c8-6cc12813c879]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:40 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe Feb 24 11:01:40 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:40 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD" returned: 0 in 0.682s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:40 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe" returned: 0 in 0.731s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:40 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 1G Feb 24 11:01:40 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:41 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 1G" returned: 0 in 0.545s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2d23b6-3a04-4d86-a307-0c36173befbe -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:41 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2d23b6-3a04-4d86-a307-0c36173befbe -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 Feb 24 11:01:41 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:41 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2d23b6-3a04-4d86-a307-0c36173befbe -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298" returned: 0 in 0.444s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:41 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:01:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:41 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 Feb 24 11:01:41 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:42 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298" returned: 0 in 0.478s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:42 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.info Feb 24 11:01:42 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:42 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.info" returned: 0 in 0.508s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:42 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.info is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:01:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:42 devstack sudo[85924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.info Feb 24 11:01:42 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:43 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.info" returned: 0 in 0.404s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.180s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.334s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:43 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Creating offline snapshot 2a108431-5520-4768-adb1-461854eaa02a of volume dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:01:43 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9104a315-ba4b-44f5-85d9-811ef5706a49]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:43 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-1548b634-5442-4fda-ad02-87422bbe5cb9 tempest-GroupSnapshotsTest-1549686521 None] group_snapshot 2916c75a-95f2-403e-a0d1-5f6e12327aa0: created successfully Feb 24 11:01:43 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 Feb 24 11:01:43 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:43 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4" returned: 0 in 0.582s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:43 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a 1G Feb 24 11:01:43 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:44 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] group_snapshot 2916c75a-95f2-403e-a0d1-5f6e12327aa0: deleting Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] group_snapshot 2916c75a-95f2-403e-a0d1-5f6e12327aa0: deleting {{(pid=82627) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-97112f79-e253-469e-83d5-fc73ed0b88b6" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-97112f79-e253-469e-83d5-fc73ed0b88b6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-6af7b8c2-4e11-498c-ba75-bb60c5c036cb" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-6af7b8c2-4e11-498c-ba75-bb60c5c036cb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Deleting offline snapshot 6af7b8c2-4e11-498c-ba75-bb60c5c036cb of volume 97112f79-e253-469e-83d5-fc73ed0b88b6 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] snapshot_file for this snap is: volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[95427e2c-f47e-4bc0-b9a2-943a3188c975]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:44 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb Feb 24 11:01:44 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:44 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a 1G" returned: 0 in 0.616s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd232719-dbc2-4a47-86a8-6956d20159e4 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:44 devstack sudo[85946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd232719-dbc2-4a47-86a8-6956d20159e4 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a Feb 24 11:01:44 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:44 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb" returned: 0 in 0.638s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97112f79-e253-469e-83d5-fc73ed0b88b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:01:44 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd232719-dbc2-4a47-86a8-6956d20159e4 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a" returned: 0 in 0.417s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:44 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a is being set with open permissions: ugo+rw Feb 24 11:01:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:45 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[51717aab-4b76-45e3-b7cb-ceef6ed3c56b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:45 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a Feb 24 11:01:45 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:45 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 Feb 24 11:01:45 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:45 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a" returned: 0 in 0.856s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:45 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6" returned: 0 in 0.938s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:45 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.info Feb 24 11:01:45 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:45 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb Feb 24 11:01:45 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:46 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.info" returned: 0 in 0.913s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:46 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.info is being set with open permissions: ugo+rw Feb 24 11:01:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:46 devstack sudo[85997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.info Feb 24 11:01:46 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:46 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb" returned: 0 in 0.973s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:46 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb Feb 24 11:01:46 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:47 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.info" returned: 0 in 0.528s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.029s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.013s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30d7a0a-afc5-478b-bacb-f5c15cfee5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9196d1155245b7ac6a66607abf84d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:38Z,use_quota=True,user_id='1a135edf51ef476d8e593ad39b30a086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Creating volume a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:47 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:47 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea 1073741824 Feb 24 11:01:47 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:47 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-62154757-afcd-4d21-a94c-701bac3e211f tempest-VolumesExtendTest-6593106 None] Create snapshot completed successfully Feb 24 11:01:47 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5af98928-6e5a-43e2-b409-f3badacd21bd tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6.6af7b8c2-4e11-498c-ba75-bb60c5c036cb" returned: 0 in 0.886s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-6af7b8c2-4e11-498c-ba75-bb60c5c036cb" released by "_delete_snapshot" :: held 3.551s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-97112f79-e253-469e-83d5-fc73ed0b88b6" released by "delete_snapshot" :: held 3.571s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-5c2d23b6-3a04-4d86-a307-0c36173befbe" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-091d3fc6-bc71-48ff-bc86-5ba292119b40 tempest-VolumesActionsTest-1516436239 None] Acquiring lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" by "attach_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-5c2d23b6-3a04-4d86-a307-0c36173befbe" acquired by "delete_snapshot" :: waited 0.050s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-e03fe66a-deb7-469e-a5bf-8ff457290298" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-091d3fc6-bc71-48ff-bc86-5ba292119b40 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" acquired by "attach_volume" :: waited 0.055s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-e03fe66a-deb7-469e-a5bf-8ff457290298" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Deleting offline snapshot e03fe66a-deb7-469e-a5bf-8ff457290298 of volume 5c2d23b6-3a04-4d86-a307-0c36173befbe {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] snapshot_file for this snap is: volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[12310451-c422-4744-a3e0-39239695ea9d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:48 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 Feb 24 11:01:48 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:48 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-091d3fc6-bc71-48ff-bc86-5ba292119b40 tempest-VolumesActionsTest-1516436239 None] Attaching volume 99c5fcff-aa9d-4144-ae4e-978afec9ef9a to instance e6696f7d-d6de-481f-9f04-7affa6c8c506 at mountpoint /dev/vdb on host None. Feb 24 11:01:48 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-091d3fc6-bc71-48ff-bc86-5ba292119b40 tempest-VolumesActionsTest-1516436239 None] Attach volume completed successfully. Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-091d3fc6-bc71-48ff-bc86-5ba292119b40 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" released by "attach_volume" :: held 0.241s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:48 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea 1073741824" returned: 0 in 0.960s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:48 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:01:48 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3654ef58-5e61-410b-8181-29fa9fab6d50 tempest-VolumesActionsTest-1516436239 None] Acquiring lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-detach_volume" by "detach_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3654ef58-5e61-410b-8181-29fa9fab6d50 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:48 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3654ef58-5e61-410b-8181-29fa9fab6d50 tempest-VolumesActionsTest-1516436239 None] Detaching volume 99c5fcff-aa9d-4144-ae4e-978afec9ef9a from instance e6696f7d-d6de-481f-9f04-7affa6c8c506. Feb 24 11:01:48 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298" returned: 0 in 0.633s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c2d23b6-3a04-4d86-a307-0c36173befbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff57ac-a4fd-4a24-8b16-e136ea6145dc]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:48 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3654ef58-5e61-410b-8181-29fa9fab6d50 tempest-VolumesActionsTest-1516436239 None] Detach volume completed successfully. Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3654ef58-5e61-410b-8181-29fa9fab6d50 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:48 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe Feb 24 11:01:48 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:48 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 0 in 0.603s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5af98928-6e5a-43e2-b409-f3badacd21bd tempest-VolumesExtendTest-6593106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.184s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:49 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e884d8-6f98-48b1-a69a-c55577ba0224]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5af98928-6e5a-43e2-b409-f3badacd21bd tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:49 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Attempting download of 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume a30d7a0a-afc5-478b-bacb-f5c15cfee5ea. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 24 11:01:49 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae263aaf-d315-4639-b7d7-97c899ea04ad]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_7rwatc9f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:49 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 Feb 24 11:01:49 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:49 devstack sudo[86020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_7rwatc9f Feb 24 11:01:49 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:49 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe" returned: 0 in 0.996s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:49 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 Feb 24 11:01:49 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:50 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5af98928-6e5a-43e2-b409-f3badacd21bd tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4" returned: 0 in 1.187s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5af98928-6e5a-43e2-b409-f3badacd21bd tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a 2G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:50 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_7rwatc9f" returned: 0 in 1.136s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_7rwatc9f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5af98928-6e5a-43e2-b409-f3badacd21bd tempest-VolumesExtendTest-6593106 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a 2G" returned: 0 in 0.101s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5af98928-6e5a-43e2-b409-f3badacd21bd tempest-VolumesExtendTest-6593106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.346s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:50 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_7rwatc9f Feb 24 11:01:50 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:50 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5af98928-6e5a-43e2-b409-f3badacd21bd tempest-VolumesExtendTest-6593106 None] Extend volume completed successfully. Feb 24 11:01:50 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298" returned: 0 in 0.865s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:50 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298 Feb 24 11:01:50 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:50 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_7rwatc9f" returned: 1 in 0.738s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_7rwatc9f' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[05003e3e-bc9c-45dd-8a22-09cd612be081]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:51 devstack sudo[86065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD Feb 24 11:01:51 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:51 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe.e03fe66a-deb7-469e-a5bf-8ff457290298" returned: 0 in 0.768s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-e03fe66a-deb7-469e-a5bf-8ff457290298" released by "_delete_snapshot" :: held 3.379s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-5c2d23b6-3a04-4d86-a307-0c36173befbe" released by "delete_snapshot" :: held 3.423s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Acquiring lock "cinder-2a108431-5520-4768-adb1-461854eaa02a-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Lock "cinder-2a108431-5520-4768-adb1-461854eaa02a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Acquiring lock "cinder-quobyte-dd232719-dbc2-4a47-86a8-6956d20159e4" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:51 devstack cinder-volume[82627]: WARNING cinder.quota [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-641053663 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-641053663, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:01:51 devstack cinder-volume[82627]: WARNING cinder.quota [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-641053663 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-641053663, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Lock "cinder-quobyte-dd232719-dbc2-4a47-86a8-6956d20159e4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Acquiring lock "cinder-quobyte-2a108431-5520-4768-adb1-461854eaa02a" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['4e7210fa-ff1e-4a05-ba64-8a5b90c7a04a', 'f3a8f061-d462-418f-8a2e-f5fa6410d992', '750b4ad9-838f-4dec-9b04-b22a1746fcb7', '126f3bc9-5cb3-4970-909b-4e149847b149'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Lock "cinder-quobyte-2a108431-5520-4768-adb1-461854eaa02a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Deleting offline snapshot 2a108431-5520-4768-adb1-461854eaa02a of volume dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] snapshot_file for this snap is: volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f3726e-a8b1-415d-a1a9-2e13cd0a958c]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['9ad0bd51-5d5c-4497-9c66-431f66ad3715', 'a6de6e34-68e3-4f5f-9dad-11e2484577d7', 'bcbe1778-81f2-4de3-af36-81301e250ac1', 'cbf907c1-02fd-4dc4-875b-c02ab02c8a57'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:51 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:51 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a Feb 24 11:01:51 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD" returned: 0 in 0.667s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] 4158f967-877e-452e-b5d3-debeeb743c37 was qcow2, converting to raw {{(pid=82627) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 24 11:01:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:51 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:01:51 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:51 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-af2f3344-b3cb-413d-8cdf-9a0baf7148ad tempest-GroupSnapshotsTest-1549686521 None] group_snapshot 2916c75a-95f2-403e-a0d1-5f6e12327aa0: deleted successfully Feb 24 11:01:52 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a" returned: 0 in 0.623s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd232719-dbc2-4a47-86a8-6956d20159e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:01:52 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaf2da1-3dbf-49fc-9def-ffbaa6ca4b3a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:52 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 Feb 24 11:01:52 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:52 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 0 in 1.166s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:52 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_f9rwnmd8devstack@QuobyteHD, size 112.00 MB, duration 1.17 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:01:52 devstack cinder-volume[82627]: INFO cinder.image.image_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Converted 112.00 MB image at 95.79 MB/s Feb 24 11:01:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:52 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea 1G Feb 24 11:01:52 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-5c2d23b6-3a04-4d86-a307-0c36173befbe" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-5c2d23b6-3a04-4d86-a307-0c36173befbe" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a133ac6-88d1-4485-b9d9-d26c080e793d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:53 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4" returned: 0 in 0.945s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:53 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a Feb 24 11:01:53 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:53 devstack sudo[86105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe Feb 24 11:01:53 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:53 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea 1G" returned: 0 in 0.644s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdea75e9-7b54-4e20-9c58-887e1cd0b6cb]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:53 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe" returned: 0 in 0.586s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:53 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:01:53 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:53 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe Feb 24 11:01:53 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:53 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a" returned: 0 in 0.703s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:53 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a Feb 24 11:01:53 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:54 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:54 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c2d23b6-3a04-4d86-a307-0c36173befbe" returned: 0 in 0.525s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-5c2d23b6-3a04-4d86-a307-0c36173befbe" released by "delete_volume" :: held 1.152s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-97112f79-e253-469e-83d5-fc73ed0b88b6" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 0 in 0.705s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-97112f79-e253-469e-83d5-fc73ed0b88b6" acquired by "delete_volume" :: waited 0.018s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dbe04b-7fb9-4883-9899-40474ce53768]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:54 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:01:54 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:54 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 Feb 24 11:01:54 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:54 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4.2a108431-5520-4768-adb1-461854eaa02a" returned: 0 in 0.547s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Lock "cinder-quobyte-2a108431-5520-4768-adb1-461854eaa02a" released by "_delete_snapshot" :: held 2.889s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Lock "cinder-quobyte-dd232719-dbc2-4a47-86a8-6956d20159e4" released by "delete_snapshot" :: held 2.912s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Created reservations ['3d933f0e-06ae-4f7c-a46a-68af592da831', '58d6f0e7-9163-4f0d-b2d5-d10195ead023', '48597bcb-5b6f-477a-b931-d673db0e086f', '2ece5ac8-61fd-49f5-8488-3b21f441fdfa'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Delete snapshot completed successfully. Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6d53bd7a-06a3-45c6-a68a-84542e143ad2 tempest-VolumesExtendTest-6593106 None] Lock "cinder-2a108431-5520-4768-adb1-461854eaa02a-delete_snapshot" released by "delete_snapshot" :: held 3.014s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Acquiring lock "cinder-dd232719-dbc2-4a47-86a8-6956d20159e4-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Lock "cinder-dd232719-dbc2-4a47-86a8-6956d20159e4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Acquiring lock "cinder-quobyte-dd232719-dbc2-4a47-86a8-6956d20159e4" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:01:54 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Lock "cinder-quobyte-dd232719-dbc2-4a47-86a8-6956d20159e4" acquired by "delete_volume" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 1 in 0.550s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Downloaded image 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume a30d7a0a-afc5-478b-bacb-f5c15cfee5ea successfully. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 for user 1a135edf51ef476d8e593ad39b30a086 is deleted. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Marking volume a30d7a0a-afc5-478b-bacb-f5c15cfee5ea as bootable. {{(pid=82627) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b38e52-8238-458f-b348-8e43098d807b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Copying metadata from image 4158f967-877e-452e-b5d3-debeeb743c37 to a30d7a0a-afc5-478b-bacb-f5c15cfee5ea. {{(pid=82627) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Creating volume glance metadata for volume a30d7a0a-afc5-478b-bacb-f5c15cfee5ea backed by image 4158f967-877e-452e-b5d3-debeeb743c37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82627) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 24 11:01:54 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 Feb 24 11:01:54 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd254b51-fdd2-4819-b75e-f52f92c1563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6978eed1-c45b-4837-b9ab-8e5535f93a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:54 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Volume volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea (a30d7a0a-afc5-478b-bacb-f5c15cfee5ea): created successfully Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6978eed1-c45b-4837-b9ab-8e5535f93a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Flow 'volume_create_manager' (aa54e532-3ba1-40c1-9c48-70918988d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:54 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6" returned: 0 in 0.662s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-795757b4-d62e-49e3-a823-50ac664c54e8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Created volume successfully. Feb 24 11:01:54 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6 Feb 24 11:01:54 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:55 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4" returned: 0 in 0.523s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:55 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4 Feb 24 11:01:55 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:55 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-97112f79-e253-469e-83d5-fc73ed0b88b6" returned: 0 in 0.541s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-97112f79-e253-469e-83d5-fc73ed0b88b6" released by "delete_volume" :: held 1.235s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['f3951c6b-a078-4bd8-a4f3-22100ea7ff25'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:55 devstack cinder-volume[82627]: WARNING cinder.quota [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-641053663 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-641053663, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['1d90dcbd-cede-473c-b082-6766eebd37ee', 'ebd263d8-38ee-40e1-a2e2-5cc1a2fb4469', '7ad9cab0-8539-4995-8a31-619f3dbe071d', '41fd4bb7-8424-46cc-85bc-743c06d26073'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['6f01fc31-34e9-4666-9611-f830b003af4e', '8be4d78b-7e97-481a-9e61-dbcd6c783699', '555ed8b6-0d0a-4133-9872-40bcf4c27396', 'eefbaeee-f022-4284-a635-ed02813125f7'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:55 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:55 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:55 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-dd232719-dbc2-4a47-86a8-6956d20159e4" returned: 0 in 0.445s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Lock "cinder-quobyte-dd232719-dbc2-4a47-86a8-6956d20159e4" released by "delete_volume" :: held 1.016s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Created reservations ['112a8366-626f-48f9-8cc9-96647a5f1073', 'e69bcd0a-2f35-40c4-b10f-9bb468454090', '4f2a7c99-8360-4eea-84d7-df1396d42559', '75a619f0-e548-46a7-8037-fa7b83a428ee'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:55 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:01:55 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:56 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.464s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4b0ea6d7-bfa3-432d-bffb-b5c985e9ece0 tempest-GroupSnapshotsTest-1549686521 None] Delete group completed successfully. Feb 24 11:01:56 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.569s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:01:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Deleted volume successfully. Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f2613716-9222-4d60-9005-7c7d8cb766cb tempest-VolumesExtendTest-6593106 None] Lock "cinder-dd232719-dbc2-4a47-86a8-6956d20159e4-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:01:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-020590e7-4dfa-4f8c-b60d-f05b28b407de tempest-GroupSnapshotsTest-1549686521 None] Group tempest-GroupSnapshotsTest-Group-1510858672: creating Feb 24 11:01:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-020590e7-4dfa-4f8c-b60d-f05b28b407de tempest-GroupSnapshotsTest-1549686521 None] Group tempest-GroupSnapshotsTest-Group-1510858672: created successfully Feb 24 11:01:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-020590e7-4dfa-4f8c-b60d-f05b28b407de tempest-GroupSnapshotsTest-1549686521 None] Create group completed successfully. Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ef62ca-b4a1-4d98-8d73-1ea51bb83453]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:01:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:57 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:01:57 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:57 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 0 in 0.644s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:57 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:01:57 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Flow 'volume_create_manager' (cc2467b7-adbe-420e-a12a-e4ca09130a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13143960-3622-43c6-acda-6dd6ab5a8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13143960-3622-43c6-acda-6dd6ab5a8074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1493023874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a58b0c95-02f4-44a0-9d84-4fc8bed6884e,host='devstack@QuobyteHD#QuobyteHD',id=cc1c6906-6808-42d7-80df-8b2921ceb197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d7afac769b4e6c935c1ca2b142e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:58Z,use_quota=True,user_id='ee037e83f9f244ae914aff8a29c5a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(612c27e0-bfc3-4a4f-856c-ef48ce411512),volume_type_id=612c27e0-bfc3-4a4f-856c-ef48ce411512)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1156ac-c2a9-4a56-8dc9-8fa61e722a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1156ac-c2a9-4a56-8dc9-8fa61e722a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d26cf1-6e59-49f2-9584-5aa8fb347af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d26cf1-6e59-49f2-9584-5aa8fb347af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1c6906-6808-42d7-80df-8b2921ceb197', 'volume_name': 'volume-cc1c6906-6808-42d7-80df-8b2921ceb197', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c786177-d60f-4b9e-bb5e-4f83781d0d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c786177-d60f-4b9e-bb5e-4f83781d0d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300d0fac-1652-438c-8332-d00d9a955416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Volume cc1c6906-6808-42d7-80df-8b2921ceb197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1c6906-6808-42d7-80df-8b2921ceb197', 'volume_size': 1} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:58 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 1 in 0.642s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.319s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a58b0c95-02f4-44a0-9d84-4fc8bed6884e,created_at=2026-02-24T10:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1493023874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a58b0c95-02f4-44a0-9d84-4fc8bed6884e,host='devstack@QuobyteHD#QuobyteHD',id=cc1c6906-6808-42d7-80df-8b2921ceb197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d7afac769b4e6c935c1ca2b142e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:58Z,use_quota=True,user_id='ee037e83f9f244ae914aff8a29c5a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(612c27e0-bfc3-4a4f-856c-ef48ce411512),volume_type_id=612c27e0-bfc3-4a4f-856c-ef48ce411512)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Creating volume cc1c6906-6808-42d7-80df-8b2921ceb197 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:58 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:58 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 1073741824 Feb 24 11:01:58 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37', 'name': 'volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '501cd59a-4a81-4158-a2d3-2116ce773314', 'enforce_multipath': True} {{(pid=82627) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 24 11:01:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-1a73a243-5c59-43cd-a236-7b9261e0fbbb req-a74ae86d-6478-485c-8393-0d0d87b8bc73 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] attachment_update completed successfully. Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Flow 'volume_create_manager' (269323b2-eb5a-432f-865e-c57314efd966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ea753c-5c57-47de-b7a7-bc897c08e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ea753c-5c57-47de-b7a7-bc897c08e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1231932805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7702e8-a540-480f-b585-db17eb154c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8b425f78024579be4619f1ebc0d1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:59Z,use_quota=True,user_id='40f1239748524f9e9160d450e0fb63b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d04004-0b5b-4319-81fe-a46235848be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d04004-0b5b-4319-81fe-a46235848be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:58 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2bd39b-be8c-43f4-aeb0-02b4bc9faa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2bd39b-be8c-43f4-aeb0-02b4bc9faa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7702e8-a540-480f-b585-db17eb154c06', 'volume_name': 'volume-4c7702e8-a540-480f-b585-db17eb154c06', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d4e015-6854-4041-9159-a99b36bef31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d4e015-6854-4041-9159-a99b36bef31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf8d857-5942-4109-bc17-14f57c04d769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:58 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Volume 4c7702e8-a540-480f-b585-db17eb154c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7702e8-a540-480f-b585-db17eb154c06', 'volume_size': 1} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 1073741824" returned: 0 in 0.699s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:59 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 Feb 24 11:01:59 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:59 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197" returned: 0 in 0.457s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1231932805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7702e8-a540-480f-b585-db17eb154c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8b425f78024579be4619f1ebc0d1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:01:59Z,use_quota=True,user_id='40f1239748524f9e9160d450e0fb63b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Creating volume 4c7702e8-a540-480f-b585-db17eb154c06 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:01:59 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300d0fac-1652-438c-8332-d00d9a955416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1c6906-6808-42d7-80df-8b2921ceb197', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88065b2c-ba21-42a6-93d0-01823203efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:01:59 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 1073741824 Feb 24 11:01:59 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:01:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Volume volume-cc1c6906-6808-42d7-80df-8b2921ceb197 (cc1c6906-6808-42d7-80df-8b2921ceb197): created successfully Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88065b2c-ba21-42a6-93d0-01823203efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:01:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Flow 'volume_create_manager' (cc2467b7-adbe-420e-a12a-e4ca09130a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:01:59 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f1783730-6929-49be-95c9-487c8ad82194 tempest-GroupSnapshotsTest-1549686521 None] Created volume successfully. Feb 24 11:02:00 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 1073741824" returned: 0 in 0.604s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:00 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 Feb 24 11:02:00 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] GroupSnapshot fc7e83c5-fe36-4d4a-b090-d8698ec25f75: creating. Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Group snapshot fc7e83c5-fe36-4d4a-b090-d8698ec25f75: creating. {{(pid=82627) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:00 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06" returned: 0 in 0.512s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.228s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Creating offline snapshot ddc6c21c-6a43-4c4f-a214-abac7540ad75 of volume cc1c6906-6808-42d7-80df-8b2921ceb197 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf8d857-5942-4109-bc17-14f57c04d769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7702e8-a540-480f-b585-db17eb154c06', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c8c0f6-27f1-4734-9ca5-c52943882650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f15032-4f98-4539-88c6-8f9f921df4e9]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:00 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Volume volume-4c7702e8-a540-480f-b585-db17eb154c06 (4c7702e8-a540-480f-b585-db17eb154c06): created successfully Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c8c0f6-27f1-4734-9ca5-c52943882650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Flow 'volume_create_manager' (269323b2-eb5a-432f-865e-c57314efd966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f4c0c1f9-435c-4622-8b76-c010a5d83484 tempest-VolumesNegativeTest-1234489082 None] Created volume successfully. Feb 24 11:02:00 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 Feb 24 11:02:00 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:01 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197" returned: 0 in 0.643s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:01 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 1G Feb 24 11:02:01 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:02 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 1G" returned: 0 in 0.765s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1c6906-6808-42d7-80df-8b2921ceb197 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:02 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1c6906-6808-42d7-80df-8b2921ceb197 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 Feb 24 11:02:02 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:02 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1c6906-6808-42d7-80df-8b2921ceb197 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75" returned: 0 in 0.558s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:02 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:02:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:02 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 Feb 24 11:02:02 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:03 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75" returned: 0 in 0.995s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:03 devstack sudo[86294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.info Feb 24 11:02:03 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:04 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.info" returned: 0 in 0.702s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:04 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.info is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:02:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:04 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.info Feb 24 11:02:04 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:04 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.info" returned: 0 in 0.650s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.413s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:05 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-56c6113c-3510-4797-a6d1-0eaec8b518b1 tempest-GroupSnapshotsTest-1549686521 None] group_snapshot fc7e83c5-fe36-4d4a-b090-d8698ec25f75: created successfully Feb 24 11:02:05 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] group_snapshot fc7e83c5-fe36-4d4a-b090-d8698ec25f75: deleting Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] group_snapshot fc7e83c5-fe36-4d4a-b090-d8698ec25f75: deleting {{(pid=82627) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-cc1c6906-6808-42d7-80df-8b2921ceb197" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-cc1c6906-6808-42d7-80df-8b2921ceb197" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-ddc6c21c-6a43-4c4f-a214-abac7540ad75" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-ddc6c21c-6a43-4c4f-a214-abac7540ad75" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Deleting offline snapshot ddc6c21c-6a43-4c4f-a214-abac7540ad75 of volume cc1c6906-6808-42d7-80df-8b2921ceb197 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:02:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] snapshot_file for this snap is: volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:02:06 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac317c-9923-4c2e-93b0-cfeb735dd065]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:06 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 Feb 24 11:02:06 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:06 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75" returned: 0 in 0.727s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc1c6906-6808-42d7-80df-8b2921ceb197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:02:06 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44a233f-42a2-4d01-a5e0-92b92f5a8738]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:06 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 Feb 24 11:02:06 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:07 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197" returned: 0 in 0.743s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:07 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 Feb 24 11:02:07 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:08 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75" returned: 0 in 0.753s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:08 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75 Feb 24 11:02:08 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:09 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197.ddc6c21c-6a43-4c4f-a214-abac7540ad75" returned: 0 in 1.018s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-ddc6c21c-6a43-4c4f-a214-abac7540ad75" released by "_delete_snapshot" :: held 3.366s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-cc1c6906-6808-42d7-80df-8b2921ceb197" released by "delete_snapshot" :: held 3.387s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:09 devstack cinder-volume[82627]: WARNING cinder.quota [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1725803945 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1725803945, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:02:09 devstack cinder-volume[82627]: WARNING cinder.quota [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1725803945 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1725803945, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:02:09 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['bd2c4cbd-4cb0-444e-a54a-d15f53ae85ec', 'a8b59c17-4b4e-40b8-91cd-cc3ec8b56551', '4eadc7eb-6898-4209-8b26-3f87147c8bbe', '9bdec5c3-2f19-4e0a-a8ef-0ed006e68980'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:09 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-69492c0c-5929-4f07-9cf1-937e9981cdbe tempest-GroupSnapshotsTest-1549686521 None] group_snapshot fc7e83c5-fe36-4d4a-b090-d8698ec25f75: deleted successfully Feb 24 11:02:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "cinder-quobyte-cc1c6906-6808-42d7-80df-8b2921ceb197" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-cc1c6906-6808-42d7-80df-8b2921ceb197" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:10 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb128c-b81c-4ab7-88ab-6e2099d10cd3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:10 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 Feb 24 11:02:10 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e96fde14-f249-4b95-ac86-79cbeb715707 tempest-VolumesActionsTest-1516436239 None] Acquiring lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" by "attach_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e96fde14-f249-4b95-ac86-79cbeb715707 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" acquired by "attach_volume" :: waited 0.047s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e96fde14-f249-4b95-ac86-79cbeb715707 tempest-VolumesActionsTest-1516436239 None] Attaching volume 99c5fcff-aa9d-4144-ae4e-978afec9ef9a to instance e8b6bad6-88ae-4ea0-a857-4fa93a2ed2c3 at mountpoint /dev/vdb on host None. Feb 24 11:02:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e96fde14-f249-4b95-ac86-79cbeb715707 tempest-VolumesActionsTest-1516436239 None] Attach volume completed successfully. Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e96fde14-f249-4b95-ac86-79cbeb715707 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" released by "attach_volume" :: held 0.153s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:11 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197" returned: 0 in 0.678s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:11 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197 Feb 24 11:02:11 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6872af11-e9ea-4c86-8c4a-bec9af337b3f tempest-VolumesActionsTest-1516436239 None] Acquiring lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-detach_volume" by "detach_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6872af11-e9ea-4c86-8c4a-bec9af337b3f tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6872af11-e9ea-4c86-8c4a-bec9af337b3f tempest-VolumesActionsTest-1516436239 None] Detaching volume 99c5fcff-aa9d-4144-ae4e-978afec9ef9a from instance e8b6bad6-88ae-4ea0-a857-4fa93a2ed2c3. Feb 24 11:02:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6872af11-e9ea-4c86-8c4a-bec9af337b3f tempest-VolumesActionsTest-1516436239 None] Detach volume completed successfully. Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6872af11-e9ea-4c86-8c4a-bec9af337b3f tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:11 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc1c6906-6808-42d7-80df-8b2921ceb197" returned: 0 in 0.557s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Lock "cinder-quobyte-cc1c6906-6808-42d7-80df-8b2921ceb197" released by "delete_volume" :: held 1.271s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['c25467cd-09c6-49c8-8949-c7c7a3281407'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:11 devstack cinder-volume[82627]: WARNING cinder.quota [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1725803945 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1725803945, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Created reservations ['1da4ec35-2d37-4a75-9b68-a5ddc016582b', '84d94fb2-7bf7-4bcb-8f6b-9dac01c73502', 'a8d6bcc3-8d93-4f1f-9f77-b090dcc4154b', '95790b85-b351-4814-86e2-debadcb034e9'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:11 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:11 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:12 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.590s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:12 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:12 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-db05ee1a-dd11-41f3-b87e-5c7dcb3e3565 tempest-GroupSnapshotsTest-1549686521 None] Delete group completed successfully. Feb 24 11:02:18 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:UPDATE=165,cinder:SELECT=173,cinder:INSERT=51,cinder:DELETE=8 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:02:18 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-522fb7b6-958e-4a9d-a05c-8fc2d4f4e610 tempest-GroupsTest-507430049 None] Group tempest-Group1-1938313026: creating Feb 24 11:02:18 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=181,cinder:UPDATE=172,cinder:INSERT=53,cinder:DELETE=7 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:02:18 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-522fb7b6-958e-4a9d-a05c-8fc2d4f4e610 tempest-GroupsTest-507430049 None] Group tempest-Group1-1938313026: created successfully Feb 24 11:02:18 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-522fb7b6-958e-4a9d-a05c-8fc2d4f4e610 tempest-GroupsTest-507430049 None] Create group completed successfully. Feb 24 11:02:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-88720b90-bc35-4e07-b810-9dbb4fefc45c tempest-GroupsTest-507430049 None] Group tempest-Group2-1563040294: creating Feb 24 11:02:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-88720b90-bc35-4e07-b810-9dbb4fefc45c tempest-GroupsTest-507430049 None] Group tempest-Group2-1563040294: created successfully Feb 24 11:02:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-88720b90-bc35-4e07-b810-9dbb4fefc45c tempest-GroupsTest-507430049 None] Create group completed successfully. Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Flow 'volume_create_manager' (6fc8569e-f02f-4ffc-b66a-42fce0b65ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd9a87b-2dce-41f6-8ecc-949f657e6b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd9a87b-2dce-41f6-8ecc-949f657e6b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873235606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3ce839a-d9a0-414e-b1d4-700be8939b73,host='devstack@QuobyteHD#QuobyteHD',id=73cfe196-0c1e-44b5-947e-ab01c04e3f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2d80d4092e498bbe48837655ac36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:21Z,use_quota=True,user_id='8ad2761ace1f4877ad209c16164c0e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40e72c66-0cf3-4e71-bb6c-fc9adc2e592b),volume_type_id=40e72c66-0cf3-4e71-bb6c-fc9adc2e592b)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71ac79e-6ea4-4526-9356-8a3c13578c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71ac79e-6ea4-4526-9356-8a3c13578c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df323ebf-0af3-4890-b1b6-b6642c7222ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df323ebf-0af3-4890-b1b6-b6642c7222ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73cfe196-0c1e-44b5-947e-ab01c04e3f06', 'volume_name': 'volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798653ae-8c9f-4b85-8045-89283152d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798653ae-8c9f-4b85-8045-89283152d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a6ee4c-822d-4660-90c5-6d8d8f807758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:20 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Volume 73cfe196-0c1e-44b5-947e-ab01c04e3f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06', 'volume_size': 1} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3ce839a-d9a0-414e-b1d4-700be8939b73,created_at=2026-02-24T10:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873235606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3ce839a-d9a0-414e-b1d4-700be8939b73,host='devstack@QuobyteHD#QuobyteHD',id=73cfe196-0c1e-44b5-947e-ab01c04e3f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2d80d4092e498bbe48837655ac36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:21Z,use_quota=True,user_id='8ad2761ace1f4877ad209c16164c0e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40e72c66-0cf3-4e71-bb6c-fc9adc2e592b),volume_type_id=40e72c66-0cf3-4e71-bb6c-fc9adc2e592b)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Creating volume 73cfe196-0c1e-44b5-947e-ab01c04e3f06 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:02:20 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:02:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:21 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 1073741824 Feb 24 11:02:21 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:22 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 1073741824" returned: 0 in 1.133s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:22 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 Feb 24 11:02:22 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:22 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06" returned: 0 in 0.551s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.607s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a6ee4c-822d-4660-90c5-6d8d8f807758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5baa2f9-ee06-442c-976c-c9056eaefc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeceaab6-6806-4840-9db7-c424890286ed]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:22 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Volume volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 (73cfe196-0c1e-44b5-947e-ab01c04e3f06): created successfully Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5baa2f9-ee06-442c-976c-c9056eaefc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Flow 'volume_create_manager' (6fc8569e-f02f-4ffc-b66a-42fce0b65ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:22 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-aaf9b02d-7c8e-4520-9fdf-391b6fa759d5 tempest-GroupsTest-507430049 None] Created volume successfully. Feb 24 11:02:22 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:02:22 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:23 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.668s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:23 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3722555-5904-4a6b-a325-3fefa8c125b4]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:23 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:02:23 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:23 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Acquiring lock "cinder-quobyte-73cfe196-0c1e-44b5-947e-ab01c04e3f06" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:23 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Lock "cinder-quobyte-73cfe196-0c1e-44b5-947e-ab01c04e3f06" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:23 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a5b5a2-ee63-4a43-b9d1-ff944028829f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:23 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 Feb 24 11:02:23 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:24 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.767s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.2cad6d21-5ce9-4c4f-8fc5-7117e9e4a069j8jhqjnp.img {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:24 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.2cad6d21-5ce9-4c4f-8fc5-7117e9e4a069j8jhqjnp.img Feb 24 11:02:24 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:24 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06" returned: 0 in 0.670s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:24 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06 Feb 24 11:02:24 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:25 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-73cfe196-0c1e-44b5-947e-ab01c04e3f06" returned: 0 in 0.949s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Lock "cinder-quobyte-73cfe196-0c1e-44b5-947e-ab01c04e3f06" released by "delete_volume" :: held 1.653s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:25 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Created reservations ['6d43d1cf-ae40-4b23-8fbc-3d6529aa31a9'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:25 devstack cinder-volume[82627]: WARNING cinder.quota [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1922444307 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1922444307, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:02:25 devstack cinder-volume[82627]: WARNING cinder.quota [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1922444307 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1922444307, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:02:25 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Created reservations ['8e98e087-8cb1-461b-a272-ab84e62f7869', '770487b3-8222-4d68-9db8-3b4111c6fa9b', 'e3cd93e2-8ec7-4462-931c-a79916357984', '010f7645-2f36-4daa-a900-996ac91a0403'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:26 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:26 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Created reservations ['9b3ab525-1f95-4f80-8820-5c48b79669ad'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:27 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:27 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:27 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.2cad6d21-5ce9-4c4f-8fc5-7117e9e4a069j8jhqjnp.img" returned: 0 in 3.094s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:27 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[198577a1-939b-4404-8f2f-eeae200bcd5c]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:27 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.293s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:27 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-eedc1f40-82be-43e5-9973-21787d59a08b tempest-GroupsTest-507430049 None] Delete group completed successfully. Feb 24 11:02:27 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:02:27 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:27 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.857s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:27 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-34255a05-136c-453a-aa97-1d0833f2c198 tempest-GroupsTest-507430049 None] Delete group completed successfully. Feb 24 11:02:28 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.839s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:28 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a, size 1024.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.2cad6d21-5ce9-4c4f-8fc5-7117e9e4a069j8jhqjnp.img {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:02:28 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Converted 1024.00 MB image at 330.79 MB/s Feb 24 11:02:28 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] 2cad6d21-5ce9-4c4f-8fc5-7117e9e4a069 was raw, no need to convert to raw {{(pid=82627) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 24 11:02:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-c4c8e762-1c31-4993-90ee-6d9d4ec9ef0e tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Terminate volume connection completed successfully. Feb 24 11:02:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-c4c8e762-1c31-4993-90ee-6d9d4ec9ef0e tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Deleting attachment 501cd59a-4a81-4158-a2d3-2116ce773314. {{(pid=82627) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 24 11:02:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6b84c51b-45ff-480f-a075-652e080568aa tempest-GroupsTest-507430049 None] Group tempest-GroupsTest-Group-1288546270: creating Feb 24 11:02:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6b84c51b-45ff-480f-a075-652e080568aa tempest-GroupsTest-507430049 None] Group tempest-GroupsTest-Group-1288546270: created successfully Feb 24 11:02:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6b84c51b-45ff-480f-a075-652e080568aa tempest-GroupsTest-507430049 None] Create group completed successfully. Feb 24 11:02:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "cinder-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "cinder-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "cinder-quobyte-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "cinder-quobyte-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" acquired by "delete_volume" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:29 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3870a2db-6789-42ae-ac0c-501a5fd01cf3]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:29 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:02:29 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:29 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 0 in 0.716s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:29 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:02:29 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Flow 'volume_create_manager' (f6bc468c-69c3-4c4f-a3f8-381f32b869e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57399b3d-64a0-4960-9006-601c2beb02bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57399b3d-64a0-4960-9006-601c2beb02bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756577114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c37d9ad-e6ef-4cda-bf26-75936668f995,host='devstack@QuobyteHD#QuobyteHD',id=65dc4d10-60e6-42b1-bf33-776d810bac34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2d80d4092e498bbe48837655ac36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:30Z,use_quota=True,user_id='8ad2761ace1f4877ad209c16164c0e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331ac908-ee19-4070-98d7-1b81ed1dfd20),volume_type_id=331ac908-ee19-4070-98d7-1b81ed1dfd20)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805a3412-08ac-4d58-a446-7391015f2c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805a3412-08ac-4d58-a446-7391015f2c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d7478c-bc94-44f3-a25e-4ffacce4613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d7478c-bc94-44f3-a25e-4ffacce4613a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65dc4d10-60e6-42b1-bf33-776d810bac34', 'volume_name': 'volume-65dc4d10-60e6-42b1-bf33-776d810bac34', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bc1c25-8e7a-43e5-8587-a92dd27f79ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bc1c25-8e7a-43e5-8587-a92dd27f79ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063a9486-d257-4fd0-a1df-810bc7b44c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:30 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Volume 65dc4d10-60e6-42b1-bf33-776d810bac34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65dc4d10-60e6-42b1-bf33-776d810bac34', 'volume_size': 1} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:30 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 1 in 0.665s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:30 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea Feb 24 11:02:30 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:30 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" returned: 0 in 0.510s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "cinder-quobyte-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea" released by "delete_volume" :: held 1.967s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:30 devstack cinder-volume[82627]: DEBUG cinder.quota [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Created reservations ['1cf073b6-b63c-4bab-943c-268e81f8e5d7', 'e30e27f6-92fb-473d-a560-6239b6ef1737', '84a0feab-2133-4347-acbf-11f0ef0ed4f9', '0ec43d6b-a69a-440c-b9eb-c560bb3d5212'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:31 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:31 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:31 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.481s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG cinder.manager [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:31 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Deleted volume successfully. Feb 24 11:02:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-faeb540e-7049-414b-9ef6-f0f4d98faabb req-a61f33c1-8e48-4753-9b9f-615224a96fe1 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "cinder-a30d7a0a-afc5-478b-bacb-f5c15cfee5ea-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Acquiring lock "cinder-4c7702e8-a540-480f-b585-db17eb154c06-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Lock "cinder-4c7702e8-a540-480f-b585-db17eb154c06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Acquiring lock "cinder-quobyte-4c7702e8-a540-480f-b585-db17eb154c06" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Lock "cinder-quobyte-4c7702e8-a540-480f-b585-db17eb154c06" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:33 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c42f103-34bb-4257-8e8b-33e59bb441cc]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:33 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 Feb 24 11:02:33 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:33 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06" returned: 0 in 0.623s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:33 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06 Feb 24 11:02:33 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:34 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:34 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:34 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c7702e8-a540-480f-b585-db17eb154c06" returned: 0 in 0.628s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Lock "cinder-quobyte-4c7702e8-a540-480f-b585-db17eb154c06" released by "delete_volume" :: held 1.277s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Created reservations ['20b2bb39-ca6a-4d3e-94b5-f14682ad3929', '94db50ca-5f1a-40f8-9cbb-855ad0037cf0', 'af53577b-b4b2-415d-91cd-509658ff3c0f', '19be772c-ac49-405e-8789-48a89d6d2647'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:34 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:34 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:34 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.554s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:34 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.483s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Deleted volume successfully. Feb 24 11:02:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df616f54-ca73-40cd-8fb8-709b5baa2f78 tempest-VolumesNegativeTest-1234489082 None] Lock "cinder-4c7702e8-a540-480f-b585-db17eb154c06-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.314s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Uploaded volume to glance image-id: 2cad6d21-5ce9-4c4f-8fc5-7117e9e4a069. {{(pid=82627) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.835s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c37d9ad-e6ef-4cda-bf26-75936668f995,created_at=2026-02-24T10:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756577114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c37d9ad-e6ef-4cda-bf26-75936668f995,host='devstack@QuobyteHD#QuobyteHD',id=65dc4d10-60e6-42b1-bf33-776d810bac34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2d80d4092e498bbe48837655ac36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:30Z,use_quota=True,user_id='8ad2761ace1f4877ad209c16164c0e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331ac908-ee19-4070-98d7-1b81ed1dfd20),volume_type_id=331ac908-ee19-4070-98d7-1b81ed1dfd20)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Creating volume 65dc4d10-60e6-42b1-bf33-776d810bac34 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:02:40 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:40 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 1073741824 Feb 24 11:02:40 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:40 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-89e7adc6-8e1c-4576-aff7-7102450ecb16 tempest-VolumesActionsTest-1516436239 None] Copy volume to image completed successfully. Feb 24 11:02:40 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 1073741824" returned: 0 in 0.611s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:40 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 Feb 24 11:02:40 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:41 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34" returned: 0 in 0.628s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.069s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063a9486-d257-4fd0-a1df-810bc7b44c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65dc4d10-60e6-42b1-bf33-776d810bac34', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea31a97c-0727-4091-8df1-7ccfe4ff98ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[66226399-7f3d-4813-961e-08ad47e96ab4]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:41 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Volume volume-65dc4d10-60e6-42b1-bf33-776d810bac34 (65dc4d10-60e6-42b1-bf33-776d810bac34): created successfully Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea31a97c-0727-4091-8df1-7ccfe4ff98ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Flow 'volume_create_manager' (f6bc468c-69c3-4c4f-a3f8-381f32b869e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:41 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8d34d5e2-49fe-4679-a20b-013cfd80e110 tempest-GroupsTest-507430049 None] Created volume successfully. Feb 24 11:02:41 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:02:41 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:41 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.582s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a1a93-ce46-4950-8489-21ca88b92fa4]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:41 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:02:41 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Flow 'volume_create_manager' (7efcaa09-6381-4e33-9cfd-879c1854b1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:42 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b95e50-152e-4f70-af22-6e6a602ae53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.627s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b95e50-152e-4f70-af22-6e6a602ae53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1372601019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c37d9ad-e6ef-4cda-bf26-75936668f995,host='devstack@QuobyteHD#QuobyteHD',id=240e7d99-ad31-40b4-aa4c-3ec024bc5b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2d80d4092e498bbe48837655ac36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:42Z,use_quota=True,user_id='8ad2761ace1f4877ad209c16164c0e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331ac908-ee19-4070-98d7-1b81ed1dfd20),volume_type_id=331ac908-ee19-4070-98d7-1b81ed1dfd20)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7599a467-1da4-4f4c-a79b-a8ce032f41ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7599a467-1da4-4f4c-a79b-a8ce032f41ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:42 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img Feb 24 11:02:42 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee361316-58ce-4fc7-b6ce-eeb677c9d020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee361316-58ce-4fc7-b6ce-eeb677c9d020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240e7d99-ad31-40b4-aa4c-3ec024bc5b08', 'volume_name': 'volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee6a324-b447-4af1-b68d-76836b5f457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee6a324-b447-4af1-b68d-76836b5f457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65433e2e-a4e5-4a5d-8148-0f6267ffb9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:42 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Volume 240e7d99-ad31-40b4-aa4c-3ec024bc5b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08', 'volume_size': 1} Feb 24 11:02:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:43 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-b89c50d8-2d89-4797-85eb-ba5fe6f599c8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Terminate volume connection completed successfully. Feb 24 11:02:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-b89c50d8-2d89-4797-85eb-ba5fe6f599c8 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Deleting attachment 68bcf703-ee14-4eec-bb9b-f281f83c5782. {{(pid=82627) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "cinder-7eea4480-f843-4bb4-8df8-8cbd63c7a30e-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "cinder-7eea4480-f843-4bb4-8df8-8cbd63c7a30e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "cinder-quobyte-7eea4480-f843-4bb4-8df8-8cbd63c7a30e" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "cinder-quobyte-7eea4480-f843-4bb4-8df8-8cbd63c7a30e" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa3d4a-234a-432f-aced-285098860ea1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:44 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img" returned: 0 in 2.425s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f120289-1dd1-4075-9f81-19f8636fe15a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:44 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e Feb 24 11:02:44 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:45 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:02:45 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:45 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e" returned: 0 in 0.694s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:45 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e Feb 24 11:02:45 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:45 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.798s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:45 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a, size 1024.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:02:45 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Converted 1024.00 MB image at 422.11 MB/s Feb 24 11:02:45 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] ce4be93b-26ab-4635-b3bb-48737e8809cb was raw, converting to qcow2 {{(pid=82627) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 24 11:02:45 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24753a-0203-40ed-8e49-828bf6278f12]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:45 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img Feb 24 11:02:45 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:46 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7eea4480-f843-4bb4-8df8-8cbd63c7a30e" returned: 0 in 0.542s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "cinder-quobyte-7eea4480-f843-4bb4-8df8-8cbd63c7a30e" released by "delete_volume" :: held 1.259s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG cinder.quota [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Created reservations ['2df1ede3-90b6-4320-b439-c7b06a03eea8', '68c48ef0-0e29-4eef-bc22-2b38c5d4d8b0', '75dcd2c6-e497-41c5-bf17-65c827f8c351', 'ba589eb1-c29b-4176-9ecb-7b0c26216038'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:46 devstack sudo[86823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:46 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:46 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img" returned: 0 in 0.571s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:46 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img Feb 24 11:02:46 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:46 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.454s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG cinder.manager [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:46 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Deleted volume successfully. Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [req-0d3a3289-3b98-4c58-b060-098d6da535a1 req-12b93a7e-a5a2-4741-bb39-7e95d0fbb420 tempest-ServerBootFromVolumeStableRescueTest-1082482695 None] Lock "cinder-7eea4480-f843-4bb4-8df8-8cbd63c7a30e-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:46 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img" returned: 1 in 0.547s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:02:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img /opt/stack/data/cinder/conversion/vol_upload_2o5e6dsh {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:46 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img /opt/stack/data/cinder/conversion/vol_upload_2o5e6dsh Feb 24 11:02:46 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:47 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img /opt/stack/data/cinder/conversion/vol_upload_2o5e6dsh" returned: 0 in 0.543s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:47 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Image conversion details: src /opt/stack/data/cinder/conversion/99c5fcff-aa9d-4144-ae4e-978afec9ef9a.temp_image.ce4be93b-26ab-4635-b3bb-48737e8809cbzx9s42rg.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2o5e6dsh {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:02:47 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 24 11:02:47 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[652897eb-a948-471b-95db-d16ab7c4a51e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2o5e6dsh {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:47 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2o5e6dsh Feb 24 11:02:47 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:48 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2o5e6dsh" returned: 0 in 0.599s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (f9f40a6f-b0fc-42e7-87ff-fe1be0f3eb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c6ed57-6f08-49ce-a606-e9823b682d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c6ed57-6f08-49ce-a606-e9823b682d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-304402139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cc7b2a-aadc-4b42-bec0-8c939ad915a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3a298a16c646e2ad9928a46b958864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:48Z,use_quota=True,user_id='1b16a0fce28f445aa023b3c31b0726ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9139411-aa49-4303-b689-6e7e376b53e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9139411-aa49-4303-b689-6e7e376b53e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c890d1-c8ea-4826-907f-077b30379162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c890d1-c8ea-4826-907f-077b30379162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4cc7b2a-aadc-4b42-bec0-8c939ad915a2', 'volume_name': 'volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efbd13f-59fc-476b-b981-9f91403b7015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efbd13f-59fc-476b-b981-9f91403b7015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93a28d2-5aea-4892-85c7-f00fbc504b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:48 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume a4cc7b2a-aadc-4b42-bec0-8c939ad915a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2', 'volume_size': 1} Feb 24 11:02:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.704s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Uploaded volume to glance image-id: ce4be93b-26ab-4635-b3bb-48737e8809cb. {{(pid=82627) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.404s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c37d9ad-e6ef-4cda-bf26-75936668f995,created_at=2026-02-24T10:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1372601019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c37d9ad-e6ef-4cda-bf26-75936668f995,host='devstack@QuobyteHD#QuobyteHD',id=240e7d99-ad31-40b4-aa4c-3ec024bc5b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2d80d4092e498bbe48837655ac36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:42Z,use_quota=True,user_id='8ad2761ace1f4877ad209c16164c0e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331ac908-ee19-4070-98d7-1b81ed1dfd20),volume_type_id=331ac908-ee19-4070-98d7-1b81ed1dfd20)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Creating volume 240e7d99-ad31-40b4-aa4c-3ec024bc5b08 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:02:49 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:49 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 1073741824 Feb 24 11:02:49 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:49 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c3ce38c7-4dc0-4f4b-9e71-e02c82dcf391 tempest-VolumesActionsTest-1516436239 None] Copy volume to image completed successfully. Feb 24 11:02:49 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 1073741824" returned: 0 in 0.576s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:49 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 Feb 24 11:02:49 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Acquiring lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Acquiring lock "cinder-quobyte-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-quobyte-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5153280d-df1c-46df-b715-8c062aa798fd]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:50 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08" returned: 0 in 0.476s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.905s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-304402139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cc7b2a-aadc-4b42-bec0-8c939ad915a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3a298a16c646e2ad9928a46b958864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:48Z,use_quota=True,user_id='1b16a0fce28f445aa023b3c31b0726ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Creating volume a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:02:50 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65433e2e-a4e5-4a5d-8148-0f6267ffb9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e10527a-bb8e-47db-88d6-77eccba983d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:50 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Volume volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 (240e7d99-ad31-40b4-aa4c-3ec024bc5b08): created successfully Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e10527a-bb8e-47db-88d6-77eccba983d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:50 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:02:50 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Flow 'volume_create_manager' (7efcaa09-6381-4e33-9cfd-879c1854b1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:50 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 1073741824 Feb 24 11:02:50 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:50 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-baefaf5e-c25b-44cf-b8c5-54892f00e90e tempest-GroupsTest-507430049 None] Created volume successfully. Feb 24 11:02:50 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.589s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:50 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a Feb 24 11:02:50 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:50 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 1073741824" returned: 0 in 0.653s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:50 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 Feb 24 11:02:50 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:51 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" returned: 0 in 0.436s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-quobyte-99c5fcff-aa9d-4144-ae4e-978afec9ef9a" released by "delete_volume" :: held 1.054s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Created reservations ['5442294c-65e1-4d0a-93d7-bbc83618f699', 'e777351e-541b-483c-8e19-f18ae5169d90', 'e739a700-3f4a-43a5-afb9-26c0cac69ffd', '82a194d0-3730-4a4e-addc-d396b06410b6'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:51 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" returned: 0 in 0.417s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:51 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:51 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93a28d2-5aea-4892-85c7-f00fbc504b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895dd62f-7dd9-4ff7-bd13-ca074b16182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:51 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 (a4cc7b2a-aadc-4b42-bec0-8c939ad915a2): created successfully Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895dd62f-7dd9-4ff7-bd13-ca074b16182b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (f9f40a6f-b0fc-42e7-87ff-fe1be0f3eb4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:51 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-fdc620e4-1168-4141-b9be-2a75636d9e97 tempest-VolumesSnapshotTestJSON-1549974402 None] Created volume successfully. Feb 24 11:02:51 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-355146a3-b11b-473c-8d9c-6176e63e1a4d tempest-GroupsTest-507430049 None] Update group completed successfully. Feb 24 11:02:51 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.455s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:51 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Deleted volume successfully. Feb 24 11:02:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e114b8c5-0a6f-443f-b167-60461b667cf0 tempest-VolumesActionsTest-1516436239 None] Lock "cinder-99c5fcff-aa9d-4144-ae4e-978afec9ef9a-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Creating offline snapshot 98589f4c-0b96-4748-90c4-8d55ac0985b3 of volume a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:02:52 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7ab4a8-4c9a-4bd5-bf8c-8f01482f3077]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:52 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b58b82de-29ac-45c1-9d07-e4e315d7f655 tempest-GroupsTest-507430049 None] Update group completed successfully. Feb 24 11:02:52 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 Feb 24 11:02:52 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:53 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" returned: 0 in 0.594s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:53 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 1G Feb 24 11:02:53 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:53 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 1G" returned: 0 in 0.611s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:53 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 Feb 24 11:02:53 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Acquiring lock "cinder-quobyte-240e7d99-ad31-40b4-aa4c-3ec024bc5b08" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Lock "cinder-quobyte-240e7d99-ad31-40b4-aa4c-3ec024bc5b08" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b29188-89f1-4510-9b39-08bc8e72a80f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:54 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 Feb 24 11:02:54 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:54 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3" returned: 0 in 0.583s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:54 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 is being set with open permissions: ugo+rw Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:54 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 Feb 24 11:02:54 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:54 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08" returned: 0 in 0.637s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:54 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08 Feb 24 11:02:54 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:54 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3" returned: 0 in 0.504s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:54 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.info Feb 24 11:02:54 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:55 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-240e7d99-ad31-40b4-aa4c-3ec024bc5b08" returned: 0 in 0.495s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:55 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Lock "cinder-quobyte-240e7d99-ad31-40b4-aa4c-3ec024bc5b08" released by "delete_volume" :: held 1.174s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:55 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Acquiring lock "cinder-quobyte-65dc4d10-60e6-42b1-bf33-776d810bac34" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:55 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Lock "cinder-quobyte-65dc4d10-60e6-42b1-bf33-776d810bac34" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:55 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13a3a7-c1d0-4a17-95c9-d0d972871b60]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:55 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 Feb 24 11:02:55 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:55 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.info" returned: 0 in 0.570s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:55 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.info is being set with open permissions: ugo+rw Feb 24 11:02:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:55 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.info Feb 24 11:02:55 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:56 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34" returned: 0 in 0.692s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:56 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.info" returned: 0 in 0.538s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.487s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:56 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34 Feb 24 11:02:56 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3af891b9-87f0-438d-a777-f355beb7c7c2 tempest-VolumesSnapshotTestJSON-1549974402 None] Create snapshot completed successfully Feb 24 11:02:56 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65dc4d10-60e6-42b1-bf33-776d810bac34" returned: 0 in 0.470s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Lock "cinder-quobyte-65dc4d10-60e6-42b1-bf33-776d810bac34" released by "delete_volume" :: held 1.199s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Created reservations ['fdf374d6-8da4-4eeb-a114-16271fb830f1'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:56 devstack cinder-volume[82627]: WARNING cinder.quota [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1666761043 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1666761043, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:02:56 devstack cinder-volume[82627]: WARNING cinder.quota [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1666761043 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1666761043, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Created reservations ['54da6588-5afb-4e56-b118-ad0c35b7082d', 'f4adaa41-1e6e-4d89-b69a-f5cc1b0ba3c5', 'f8729d56-64f7-4419-898f-97fb7d4cd1fc', 'cf998943-3229-49c4-998e-cdccba4c1907'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Created reservations ['3bd22621-2789-4457-a518-ed9997bc5b2b', 'd5478e65-289e-4aac-b89c-e29927653b8e', '3578b897-26aa-408a-8668-5a12f3a00e09', 'c0ec9b9d-9686-4ac8-858d-dac2333e617b'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:56 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:02:56 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-98589f4c-0b96-4748-90c4-8d55ac0985b3-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-98589f4c-0b96-4748-90c4-8d55ac0985b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-98589f4c-0b96-4748-90c4-8d55ac0985b3" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-98589f4c-0b96-4748-90c4-8d55ac0985b3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Deleting offline snapshot 98589f4c-0b96-4748-90c4-8d55ac0985b3 of volume a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] snapshot_file for this snap is: volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2366ad8-a658-4b27-89e4-9ea1f273dcb0]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Flow 'volume_create_manager' (660185a3-1348-4e42-bc8f-b2b2d02f8ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577ac930-a32d-4139-b9c9-174ee8fbd9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577ac930-a32d-4139-b9c9-174ee8fbd9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1336024720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb028a4-1e89-49e1-8940-3f97d2e97003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79762fcbc96a41ba8a33dea3baf64672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:57Z,use_quota=True,user_id='a94da4a77c5b4cb7876c181de4e4f338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1efacf-eae5-45ef-9e6f-bb07e9a81dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1efacf-eae5-45ef-9e6f-bb07e9a81dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0369de-1684-44e1-a088-a39da318dc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0369de-1684-44e1-a088-a39da318dc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb028a4-1e89-49e1-8940-3f97d2e97003', 'volume_name': 'volume-0cb028a4-1e89-49e1-8940-3f97d2e97003', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1fe210-1fcb-4ab8-9536-6f1695832623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:57 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 Feb 24 11:02:57 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1fe210-1fcb-4ab8-9536-6f1695832623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f77b3e5-4221-48fd-8157-44cf38b38879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:57 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Volume 0cb028a4-1e89-49e1-8940-3f97d2e97003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb028a4-1e89-49e1-8940-3f97d2e97003', 'volume_size': 1} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1336024720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb028a4-1e89-49e1-8940-3f97d2e97003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79762fcbc96a41ba8a33dea3baf64672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:02:57Z,use_quota=True,user_id='a94da4a77c5b4cb7876c181de4e4f338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Creating volume 0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:02:57 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:57 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 1073741824 Feb 24 11:02:57 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:57 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.501s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:02:57 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-168584eb-7b2c-46e2-817f-eba4e53b1472 tempest-GroupsTest-507430049 None] Delete group completed successfully. Feb 24 11:02:57 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3" returned: 0 in 0.523s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3024b0d2-9cb7-4c7f-9c20-b9a115eeb320]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:57 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 Feb 24 11:02:57 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:57 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 1073741824" returned: 0 in 0.603s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:57 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 Feb 24 11:02:57 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:58 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" returned: 0 in 0.616s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:58 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 Feb 24 11:02:58 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:58 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003" returned: 0 in 0.603s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f77b3e5-4221-48fd-8157-44cf38b38879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb028a4-1e89-49e1-8940-3f97d2e97003', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27ef080-5c71-48ce-8fb3-c9799720108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:58 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Volume volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 (0cb028a4-1e89-49e1-8940-3f97d2e97003): created successfully Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27ef080-5c71-48ce-8fb3-c9799720108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Flow 'volume_create_manager' (660185a3-1348-4e42-bc8f-b2b2d02f8ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-11d87b96-059d-438a-82e0-a0d46db10b87 tempest-VolumesCloneTest-352103094 None] Created volume successfully. Feb 24 11:02:58 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3" returned: 0 in 0.658s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:58 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3 Feb 24 11:02:58 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:02:59 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2.98589f4c-0b96-4748-90c4-8d55ac0985b3" returned: 0 in 0.624s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-98589f4c-0b96-4748-90c4-8d55ac0985b3" released by "_delete_snapshot" :: held 2.511s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" released by "delete_snapshot" :: held 2.530s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Created reservations ['f4458339-528d-4460-a32e-e620f0ccaf10', '08eba1d6-d74d-4056-8589-0f68ed0023f1', '3aaf8cec-bb9a-4f98-9d1a-2a8bcf4e763b', 'c901653a-4b44-4ee9-a661-a3c300c39d58'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:02:59 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Delete snapshot completed successfully. Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-09a5650b-c1b4-466f-b1be-3d471373f477 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-98589f4c-0b96-4748-90c4-8d55ac0985b3-delete_snapshot" released by "delete_snapshot" :: held 2.688s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Flow 'volume_create_manager' (7d86785c-9b8e-41aa-8e10-686dc8766d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858a0f47-766d-4a87-af1d-2ccb0ab19bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858a0f47-766d-4a87-af1d-2ccb0ab19bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1381784998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc73079-3b57-471d-8501-1fe0870e0f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79762fcbc96a41ba8a33dea3baf64672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0cb028a4-1e89-49e1-8940-3f97d2e97003,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:00Z,use_quota=True,user_id='a94da4a77c5b4cb7876c181de4e4f338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e542635-da18-470d-b37d-f448787ff2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e542635-da18-470d-b37d-f448787ff2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7969021d-19c6-43c9-85d5-58b6882c7402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7969021d-19c6-43c9-85d5-58b6882c7402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cdc73079-3b57-471d-8501-1fe0870e0f40', 'volume_name': 'volume-cdc73079-3b57-471d-8501-1fe0870e0f40', 'volume_size': 2, 'source_volid': '0cb028a4-1e89-49e1-8940-3f97d2e97003', 'source_volstatus': 'available'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a87f4c-f102-499d-985f-fd05c9d013f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a87f4c-f102-499d-985f-fd05c9d013f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9f5055-3b63-4792-8c7d-7020e9e1e66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:02:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Volume cdc73079-3b57-471d-8501-1fe0870e0f40: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cdc73079-3b57-471d-8501-1fe0870e0f40', 'volume_size': 2, 'source_volid': '0cb028a4-1e89-49e1-8940-3f97d2e97003', 'source_volstatus': 'available'} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:02:59 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Cloning volume 0cb028a4-1e89-49e1-8940-3f97d2e97003 to volume cdc73079-3b57-471d-8501-1fe0870e0f40 Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Creating offline snapshot 05227ade-7552-43e9-969e-5a4db2316815 of volume 0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00fa3f0-dddd-41c0-ad77-dc49c2464903]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:02:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:02:59 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 Feb 24 11:02:59 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:00 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003" returned: 0 in 0.592s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:00 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 1G Feb 24 11:03:00 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (1f21eb84-3b10-464c-b13e-4ebfa02439f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de9c9ea-3214-4eb5-b038-a1b72edcf5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de9c9ea-3214-4eb5-b038-a1b72edcf5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-106203361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd98bccc-3018-4dbb-bb4e-cad895006518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3a298a16c646e2ad9928a46b958864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:00Z,use_quota=True,user_id='1b16a0fce28f445aa023b3c31b0726ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f4d49a-8aa9-4010-bc25-1e6219310d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f4d49a-8aa9-4010-bc25-1e6219310d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0c697e-c8c4-4241-a62c-df06e0301ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0c697e-c8c4-4241-a62c-df06e0301ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd98bccc-3018-4dbb-bb4e-cad895006518', 'volume_name': 'volume-bd98bccc-3018-4dbb-bb4e-cad895006518', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea6c956-091d-4bcc-a366-b972dfad8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea6c956-091d-4bcc-a366-b972dfad8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8528687-da8a-48a0-bd42-37f6def7b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:00 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume bd98bccc-3018-4dbb-bb4e-cad895006518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd98bccc-3018-4dbb-bb4e-cad895006518', 'volume_size': 1} Feb 24 11:03:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:01 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 1G" returned: 0 in 0.653s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:01 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 Feb 24 11:03:01 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:01 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815" returned: 0 in 0.560s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:01 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 is being set with open permissions: ugo+rw Feb 24 11:03:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:01 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 Feb 24 11:03:01 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:02 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815" returned: 0 in 0.533s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:02 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.info Feb 24 11:03:02 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:02 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.info" returned: 0 in 0.623s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:02 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.info is being set with open permissions: ugo+rw Feb 24 11:03:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:02 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.info Feb 24 11:03:02 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:03 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.info" returned: 0 in 0.494s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Acquiring lock "cinder-quobyte-cdc73079-3b57-471d-8501-1fe0870e0f40" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Lock "cinder-quobyte-cdc73079-3b57-471d-8501-1fe0870e0f40" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] snapshot: 05227ade-7552-43e9-969e-5a4db2316815, volume: cdc73079-3b57-471d-8501-1fe0870e0f40, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aef5ff2-3cb8-4e5f-89a4-ad92ce206362]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:03 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 Feb 24 11:03:03 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:04 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815" returned: 0 in 0.680s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cb028a4-1e89-49e1-8940-3f97d2e97003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da5c011-3e21-484b-942d-3de9a579b755]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:04 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 Feb 24 11:03:04 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:04 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003" returned: 0 in 0.600s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:03:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:04 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 Feb 24 11:03:04 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:07 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40" returned: 0 in 2.749s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:07 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[43175c0a-97cb-4169-b310-53dbaf0529a1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:07 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 Feb 24 11:03:07 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:08 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003" returned: 0 in 0.868s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003, size 1024.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:03:08 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Converted 1024.00 MB image at 372.21 MB/s Feb 24 11:03:08 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 is being set with open permissions: ugo+rw Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:08 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 Feb 24 11:03:08 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Flow 'volume_create_manager' (10a7f3ad-dd3c-4e2d-bf80-806aff7e59a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfce1ac-c69c-42c9-a678-f9772cbc82de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfce1ac-c69c-42c9-a678-f9772cbc82de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-979139428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40141d40-0ca2-4ce7-96cc-86807ffce8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fa9e889a364242bfd424ad209bf86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:08Z,use_quota=True,user_id='2c10f17e90964a649e9e3d1b92be2987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56c10f5-3879-4a58-af6e-231d476277fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56c10f5-3879-4a58-af6e-231d476277fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e6376b-6059-4478-88d0-42ae7631ae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e6376b-6059-4478-88d0-42ae7631ae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40141d40-0ca2-4ce7-96cc-86807ffce8d3', 'volume_name': 'volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9612b35-aaeb-46dc-b79d-6f8bf2c3b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9612b35-aaeb-46dc-b79d-6f8bf2c3b62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfec214-c4ac-4f3b-ae7a-d8e5529c8400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:08 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3', 'volume_size': 1} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:08 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40" returned: 0 in 0.508s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Lock "cinder-quobyte-cdc73079-3b57-471d-8501-1fe0870e0f40" released by "_copy_volume_from_snapshot" :: held 5.479s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Acquiring lock "cinder-quobyte-05227ade-7552-43e9-969e-5a4db2316815" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Lock "cinder-quobyte-05227ade-7552-43e9-969e-5a4db2316815" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Deleting offline snapshot 05227ade-7552-43e9-969e-5a4db2316815 of volume 0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] snapshot_file for this snap is: volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e52c01-8d01-4891-a6ab-6945a33d2dd9]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:08 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 Feb 24 11:03:08 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:09 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815" returned: 0 in 0.576s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cb028a4-1e89-49e1-8940-3f97d2e97003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:09 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8ad2cb-d917-499f-9029-3f270eba49f3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:09 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 Feb 24 11:03:09 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:09 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003" returned: 0 in 0.507s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:09 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 Feb 24 11:03:09 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:10 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815" returned: 0 in 0.492s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:10 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815 Feb 24 11:03:10 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:10 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003.05227ade-7552-43e9-969e-5a4db2316815" returned: 0 in 0.448s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Lock "cinder-quobyte-05227ade-7552-43e9-969e-5a4db2316815" released by "_delete_snapshot" :: held 2.084s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.173s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.344s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-106203361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd98bccc-3018-4dbb-bb4e-cad895006518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3a298a16c646e2ad9928a46b958864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:00Z,use_quota=True,user_id='1b16a0fce28f445aa023b3c31b0726ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Creating volume bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:10 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9f5055-3b63-4792-8c7d-7020e9e1e66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc73079-3b57-471d-8501-1fe0870e0f40', 'volume_size': 2, 'source_volid': '0cb028a4-1e89-49e1-8940-3f97d2e97003', 'source_volstatus': 'available'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:10 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 1073741824 Feb 24 11:03:10 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c0955f-797a-458f-b24a-142b05663245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:11 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Volume volume-cdc73079-3b57-471d-8501-1fe0870e0f40 (cdc73079-3b57-471d-8501-1fe0870e0f40): created successfully Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c0955f-797a-458f-b24a-142b05663245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Flow 'volume_create_manager' (7d86785c-9b8e-41aa-8e10-686dc8766d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d924206d-4e9f-404f-a7a4-078c32908244 tempest-VolumesCloneTest-352103094 None] Created volume successfully. Feb 24 11:03:11 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 1073741824" returned: 0 in 0.567s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:11 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 Feb 24 11:03:11 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Acquiring lock "cinder-cdc73079-3b57-471d-8501-1fe0870e0f40-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Lock "cinder-cdc73079-3b57-471d-8501-1fe0870e0f40-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Acquiring lock "cinder-quobyte-cdc73079-3b57-471d-8501-1fe0870e0f40" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Lock "cinder-quobyte-cdc73079-3b57-471d-8501-1fe0870e0f40" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[868d5795-90f8-4030-a977-5888548ab8e1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:11 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 Feb 24 11:03:11 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:12 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518" returned: 0 in 0.470s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.579s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-979139428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40141d40-0ca2-4ce7-96cc-86807ffce8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fa9e889a364242bfd424ad209bf86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:08Z,use_quota=True,user_id='2c10f17e90964a649e9e3d1b92be2987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Creating volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:12 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8528687-da8a-48a0-bd42-37f6def7b20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd98bccc-3018-4dbb-bb4e-cad895006518', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646e094b-8f5f-4e01-ba92-900fe5b90b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:12 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 1073741824 Feb 24 11:03:12 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:12 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume volume-bd98bccc-3018-4dbb-bb4e-cad895006518 (bd98bccc-3018-4dbb-bb4e-cad895006518): created successfully Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646e094b-8f5f-4e01-ba92-900fe5b90b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (1f21eb84-3b10-464c-b13e-4ebfa02439f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:12 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-899397e1-b684-44df-b042-b03f4596bed7 tempest-VolumesSnapshotTestJSON-1549974402 None] Created volume successfully. Feb 24 11:03:12 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40" returned: 0 in 0.639s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:12 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40 Feb 24 11:03:12 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:12 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 1073741824" returned: 0 in 0.679s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:12 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 Feb 24 11:03:12 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:13 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cdc73079-3b57-471d-8501-1fe0870e0f40" returned: 0 in 0.625s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Lock "cinder-quobyte-cdc73079-3b57-471d-8501-1fe0870e0f40" released by "delete_volume" :: held 1.310s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Created reservations ['7b529ca7-2f4d-40db-b976-9f81f4c447ad', '33a1388f-51e8-44f9-b1a4-fd33a13b2cb9', 'e45b00e0-e1be-4acf-878f-3ec266fcbacd', '7bf69c28-73a3-4c8a-aad1-834b486bcf03'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:13 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:03:13 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:13 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3" returned: 0 in 0.534s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.700s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfec214-c4ac-4f3b-ae7a-d8e5529c8400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f887bcc1-14cc-4fbc-9b74-23480bf89de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Creating offline snapshot 0aa004aa-39eb-49b2-8727-85f96ad73bd8 of volume bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:03:13 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Volume volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 (40141d40-0ca2-4ce7-96cc-86807ffce8d3): created successfully Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f887bcc1-14cc-4fbc-9b74-23480bf89de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Flow 'volume_create_manager' (10a7f3ad-dd3c-4e2d-bf80-806aff7e59a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cb2f41-e67a-407f-89e8-e005bd7e5276]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0eb0865e-eede-4e80-b23a-6bbaa78f365a tempest-SnapshotsActionsTest-1422410947 None] Created volume successfully. Feb 24 11:03:13 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 Feb 24 11:03:13 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:13 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.481s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:03:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Deleted volume successfully. Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b226778-617b-43ea-9170-febaeb2237f0 tempest-VolumesCloneTest-352103094 None] Lock "cinder-cdc73079-3b57-471d-8501-1fe0870e0f40-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Acquiring lock "cinder-0cb028a4-1e89-49e1-8940-3f97d2e97003-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Lock "cinder-0cb028a4-1e89-49e1-8940-3f97d2e97003-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:13 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518" returned: 0 in 0.599s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:13 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 1G Feb 24 11:03:13 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Acquiring lock "cinder-quobyte-0cb028a4-1e89-49e1-8940-3f97d2e97003" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Lock "cinder-quobyte-0cb028a4-1e89-49e1-8940-3f97d2e97003" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70cca9b-1ea0-4706-88be-8cd7bfebf599]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:14 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 Feb 24 11:03:14 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:14 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 1G" returned: 0 in 0.541s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd98bccc-3018-4dbb-bb4e-cad895006518 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:14 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd98bccc-3018-4dbb-bb4e-cad895006518 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 Feb 24 11:03:14 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:14 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003" returned: 0 in 0.563s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:14 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003 Feb 24 11:03:14 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:14 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd98bccc-3018-4dbb-bb4e-cad895006518 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8" returned: 0 in 0.440s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:14 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 is being set with open permissions: ugo+rw Feb 24 11:03:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:14 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 Feb 24 11:03:14 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:15 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0cb028a4-1e89-49e1-8940-3f97d2e97003" returned: 0 in 0.485s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Lock "cinder-quobyte-0cb028a4-1e89-49e1-8940-3f97d2e97003" released by "delete_volume" :: held 1.081s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Created reservations ['bb4456e5-9973-44ee-a86c-6ac077165d89', '610c523a-429d-4a69-9e69-1e2cbeea593e', '0faa524b-67de-48a5-a20b-5aeffeeb4f53', '2cf7140e-97e5-4518-a7be-70a56bb9e6a3'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:15 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:03:15 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:15 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8" returned: 0 in 0.491s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:15 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.info Feb 24 11:03:15 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:15 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.439s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:03:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Deleted volume successfully. Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-add3999c-b61c-42ce-9e42-bbc647f2543d tempest-VolumesCloneTest-352103094 None] Lock "cinder-0cb028a4-1e89-49e1-8940-3f97d2e97003-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:15 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.info" returned: 0 in 0.433s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:15 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.info is being set with open permissions: ugo+rw Feb 24 11:03:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:15 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.info Feb 24 11:03:15 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:16 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.info" returned: 0 in 0.483s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.076s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.289s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Creating offline snapshot c5fb6060-a030-4f96-a241-d51811abd1b1 of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:03:16 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a1421543-1830-41b1-bac6-128aaf61512f tempest-VolumesSnapshotTestJSON-1549974402 None] Create snapshot completed successfully Feb 24 11:03:16 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5b294f-f192-4915-92fe-2337bb48f939]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:16 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 Feb 24 11:03:16 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (79271bad-d68e-4ba5-9180-64317754d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71675a8a-9c2b-421b-a565-8c6c29224e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:17 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3" returned: 0 in 0.722s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71675a8a-9c2b-421b-a565-8c6c29224e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562592178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d5b581-2471-4045-beb6-32355c46ac84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3a298a16c646e2ad9928a46b958864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0aa004aa-39eb-49b2-8727-85f96ad73bd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:17Z,use_quota=True,user_id='1b16a0fce28f445aa023b3c31b0726ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0335e387-2538-43ce-be19-abc549cf2cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0335e387-2538-43ce-be19-abc549cf2cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:17 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 1G Feb 24 11:03:17 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8475cbe8-4c9f-475e-b35a-be16d7a567e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8475cbe8-4c9f-475e-b35a-be16d7a567e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18d5b581-2471-4045-beb6-32355c46ac84', 'volume_name': 'volume-18d5b581-2471-4045-beb6-32355c46ac84', 'volume_size': 2, 'snapshot_id': '0aa004aa-39eb-49b2-8727-85f96ad73bd8'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ddf77c-bed7-4e58-bbea-26aa705e1263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ddf77c-bed7-4e58-bbea-26aa705e1263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff2a663-a9f8-4709-a7b8-36d20ac393be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:17 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume 18d5b581-2471-4045-beb6-32355c46ac84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18d5b581-2471-4045-beb6-32355c46ac84', 'volume_size': 2, 'snapshot_id': '0aa004aa-39eb-49b2-8727-85f96ad73bd8'} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:17 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 1G" returned: 0 in 0.700s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:17 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:03:17 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (a9dece1e-9c9f-47bc-b59e-bbc9c6bbb098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc55ce3-d25b-491d-8498-b5da99026973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc55ce3-d25b-491d-8498-b5da99026973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2048570130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded48ddd-56d3-4675-9f43-76c35821ddea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:18Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82201b6e-222a-4277-a9f8-ed6fc4d6d6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82201b6e-222a-4277-a9f8-ed6fc4d6d6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e41b7c-6c33-4811-a6e5-62bbe23f252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e41b7c-6c33-4811-a6e5-62bbe23f252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded48ddd-56d3-4675-9f43-76c35821ddea', 'volume_name': 'volume-ded48ddd-56d3-4675-9f43-76c35821ddea', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db8e1ec-c521-4fb2-be67-a49995d1097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db8e1ec-c521-4fb2-be67-a49995d1097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250dd9e4-bed6-49b7-a094-e0042599231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:18 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Volume ded48ddd-56d3-4675-9f43-76c35821ddea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded48ddd-56d3-4675-9f43-76c35821ddea', 'volume_size': 1} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:18 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.551s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:18 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 is being set with open permissions: ugo+rw Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:18 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:03:18 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:18 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.451s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=114,cinder:UPDATE=106,cinder:DELETE=8,cinder:INSERT=29 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:UPDATE=138,cinder:SELECT=115,cinder:INSERT=26,cinder:DELETE=8 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:03:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:18 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.info Feb 24 11:03:18 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:19 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.info" returned: 0 in 0.455s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:19 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.info is being set with open permissions: ugo+rw Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:19 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.info Feb 24 11:03:19 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:19 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.info" returned: 0 in 0.546s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.513s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.692s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-0aa004aa-39eb-49b2-8727-85f96ad73bd8-18d5b581-2471-4045-beb6-32355c46ac84" by "_create_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b873179a-4712-4a64-b14d-36d838e27b86 tempest-SnapshotsActionsTest-1422410947 None] Create snapshot completed successfully Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-0aa004aa-39eb-49b2-8727-85f96ad73bd8-18d5b581-2471-4045-beb6-32355c46ac84" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Creating volume 18d5b581-2471-4045-beb6-32355c46ac84 from snapshot 0aa004aa-39eb-49b2-8727-85f96ad73bd8 {{(pid=82627) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-18d5b581-2471-4045-beb6-32355c46ac84" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-18d5b581-2471-4045-beb6-32355c46ac84" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] snapshot: 0aa004aa-39eb-49b2-8727-85f96ad73bd8, volume: 18d5b581-2471-4045-beb6-32355c46ac84, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca695d-f8bf-45de-8793-9224b0f94379]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:20 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 Feb 24 11:03:20 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:20 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8" returned: 0 in 0.617s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd98bccc-3018-4dbb-bb4e-cad895006518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:03:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:03:20 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ba9a66-c29d-4d46-b9ce-0319ef2a3e65]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:20 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 Feb 24 11:03:20 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:21 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518" returned: 0 in 0.561s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:21 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:03:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:21 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 Feb 24 11:03:21 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:23 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84" returned: 0 in 2.184s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:23 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[370f8c46-1729-4d45-932e-2df8a1bc94ef]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:23 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 Feb 24 11:03:23 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:24 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518" returned: 0 in 0.850s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:03:24 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Converted 1024.00 MB image at 468.62 MB/s Feb 24 11:03:24 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 is being set with open permissions: ugo+rw Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:24 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 Feb 24 11:03:24 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:24 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84" returned: 0 in 0.507s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-18d5b581-2471-4045-beb6-32355c46ac84" released by "_copy_volume_from_snapshot" :: held 4.785s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-0aa004aa-39eb-49b2-8727-85f96ad73bd8-18d5b581-2471-4045-beb6-32355c46ac84" released by "_create_volume_from_snapshot" :: held 4.805s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.832s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.424s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2048570130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded48ddd-56d3-4675-9f43-76c35821ddea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:18Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Creating volume ded48ddd-56d3-4675-9f43-76c35821ddea {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:24 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:24 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea 1073741824 Feb 24 11:03:24 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff2a663-a9f8-4709-a7b8-36d20ac393be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d5b581-2471-4045-beb6-32355c46ac84', 'volume_size': 2, 'snapshot_id': '0aa004aa-39eb-49b2-8727-85f96ad73bd8'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d0eb10-50fd-4eee-a8ee-e4240963b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:24 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume volume-18d5b581-2471-4045-beb6-32355c46ac84 (18d5b581-2471-4045-beb6-32355c46ac84): created successfully Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d0eb10-50fd-4eee-a8ee-e4240963b311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (79271bad-d68e-4ba5-9180-64317754d27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:24 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-55a47675-066a-43c2-bda1-dc7030a17662 tempest-VolumesSnapshotTestJSON-1549974402 None] Created volume successfully. Feb 24 11:03:25 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea 1073741824" returned: 0 in 0.566s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:25 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea Feb 24 11:03:25 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-18d5b581-2471-4045-beb6-32355c46ac84-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-18d5b581-2471-4045-beb6-32355c46ac84-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-18d5b581-2471-4045-beb6-32355c46ac84" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-18d5b581-2471-4045-beb6-32355c46ac84" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5b50e2-6509-4b8f-b09e-f83e102ef9be]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:25 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea" returned: 0 in 0.506s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:25 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 Feb 24 11:03:25 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.115s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250dd9e4-bed6-49b7-a094-e0042599231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded48ddd-56d3-4675-9f43-76c35821ddea', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fd1529-fafa-4d94-aa48-8b44e0e14795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:25 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Volume volume-ded48ddd-56d3-4675-9f43-76c35821ddea (ded48ddd-56d3-4675-9f43-76c35821ddea): created successfully Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fd1529-fafa-4d94-aa48-8b44e0e14795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (a9dece1e-9c9f-47bc-b59e-bbc9c6bbb098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:26 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-1b02e1be-b18c-46e5-b0c3-ab99ba0c7d58 tempest-VolumesGetTest-2116324429 None] Created volume successfully. Feb 24 11:03:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Creating offline snapshot 5aadcbb2-f175-44ed-b422-615751ea7ecb of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:03:26 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f4062b-ae9c-40c5-9f28-dd0af117ac43]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:26 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:03:26 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:26 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.891s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:27 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84" returned: 0 in 1.336s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:27 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb 1G Feb 24 11:03:27 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:27 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84 Feb 24 11:03:27 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (92f8ee28-ac25-4920-a89d-416d19a9d122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671d8fbe-6242-4947-a3c3-c5cb7f0a3387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671d8fbe-6242-4947-a3c3-c5cb7f0a3387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-463896057',display_name='tempest-VolumesGetTest-Volume-1277308525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497517aa-14cd-45b7-823d-4ff02710e125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:28Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91aff0ad-2d3c-4d3c-8e84-f09b0da274df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91aff0ad-2d3c-4d3c-8e84-f09b0da274df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69155aa7-f677-4aba-8772-12eeb8df6896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69155aa7-f677-4aba-8772-12eeb8df6896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497517aa-14cd-45b7-823d-4ff02710e125', 'volume_name': 'volume-497517aa-14cd-45b7-823d-4ff02710e125', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25483620-a1e0-4cf8-9ce4-d692f23e0f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25483620-a1e0-4cf8-9ce4-d692f23e0f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2896e65-5c1d-4757-b63f-e3ac02225252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:28 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Volume 497517aa-14cd-45b7-823d-4ff02710e125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497517aa-14cd-45b7-823d-4ff02710e125', 'volume_size': 1} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:28 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18d5b581-2471-4045-beb6-32355c46ac84" returned: 0 in 1.021s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-18d5b581-2471-4045-beb6-32355c46ac84" released by "delete_volume" :: held 2.401s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Created reservations ['8173629e-f7e2-45b0-80d7-aad8eab36658', 'c3476274-0418-420c-a240-e99d0602dccb', '182d85c8-3a85-4870-9ae5-b1ab9d3006c1', '66e321bd-df02-4919-bd3c-8483a0f46162'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:28 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:03:28 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:28 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb 1G" returned: 0 in 1.365s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:28 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb Feb 24 11:03:28 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:28 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.503s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:03:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Deleted volume successfully. Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e9277c4-4512-443e-9318-17344e487b11 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-18d5b581-2471-4045-beb6-32355c46ac84-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:28 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb" returned: 0 in 0.513s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:28 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb is being set with open permissions: ugo+rw Feb 24 11:03:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:28 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb Feb 24 11:03:28 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-0aa004aa-39eb-49b2-8727-85f96ad73bd8-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-0aa004aa-39eb-49b2-8727-85f96ad73bd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-bd98bccc-3018-4dbb-bb4e-cad895006518" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-bd98bccc-3018-4dbb-bb4e-cad895006518" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-0aa004aa-39eb-49b2-8727-85f96ad73bd8" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-0aa004aa-39eb-49b2-8727-85f96ad73bd8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Deleting offline snapshot 0aa004aa-39eb-49b2-8727-85f96ad73bd8 of volume bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] snapshot_file for this snap is: volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d3b92-13e2-46b8-96d0-cf138b8c4b88]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:29 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 Feb 24 11:03:29 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:29 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb" returned: 0 in 0.633s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.735s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-463896057',display_name='tempest-VolumesGetTest-Volume-1277308525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497517aa-14cd-45b7-823d-4ff02710e125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:28Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Creating volume 497517aa-14cd-45b7-823d-4ff02710e125 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:29 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:03:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:29 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 1073741824 Feb 24 11:03:29 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:29 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-2aa19fd7-ed00-4612-a4f5-7ad6805063f1 tempest-SnapshotsActionsTest-1422410947 None] Create snapshot completed successfully Feb 24 11:03:30 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8" returned: 0 in 0.720s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd98bccc-3018-4dbb-bb4e-cad895006518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e1554-b8e2-45b8-8885-6cb8728d1a20]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:30 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 Feb 24 11:03:30 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:30 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 1073741824" returned: 0 in 0.732s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:30 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 Feb 24 11:03:30 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-5aadcbb2-f175-44ed-b422-615751ea7ecb-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-5aadcbb2-f175-44ed-b422-615751ea7ecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-quobyte-5aadcbb2-f175-44ed-b422-615751ea7ecb" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-5aadcbb2-f175-44ed-b422-615751ea7ecb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Deleting offline snapshot 5aadcbb2-f175-44ed-b422-615751ea7ecb of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] snapshot_file for this snap is: volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0195151-abca-472f-b072-311ca09a8637]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:30 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb Feb 24 11:03:30 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:30 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518" returned: 0 in 0.744s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:30 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 Feb 24 11:03:30 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:31 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125" returned: 0 in 1.039s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2896e65-5c1d-4757-b63f-e3ac02225252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497517aa-14cd-45b7-823d-4ff02710e125', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfe1e92-8de2-4bb1-a26b-73d04dc1cde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:31 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Volume volume-497517aa-14cd-45b7-823d-4ff02710e125 (497517aa-14cd-45b7-823d-4ff02710e125): created successfully Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfe1e92-8de2-4bb1-a26b-73d04dc1cde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (92f8ee28-ac25-4920-a89d-416d19a9d122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:31 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-cf0a493e-c6c6-4350-a8b9-53a879f44950 tempest-VolumesGetTest-2116324429 None] Created volume successfully. Feb 24 11:03:31 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb" returned: 0 in 1.087s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3598ab86-0c15-439a-9077-c4bd9c1c39c3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:31 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8" returned: 0 in 0.906s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:31 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8 Feb 24 11:03:31 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:31 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:03:31 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:32 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518.0aa004aa-39eb-49b2-8727-85f96ad73bd8" returned: 0 in 0.388s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-0aa004aa-39eb-49b2-8727-85f96ad73bd8" released by "_delete_snapshot" :: held 2.874s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-bd98bccc-3018-4dbb-bb4e-cad895006518" released by "delete_snapshot" :: held 2.889s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Created reservations ['1c6c9b24-1ea5-40de-8f71-dae4025d35c7', 'bd3c7043-9c29-4fb2-8a4f-a9ea5f9acd1b', '2468e500-9d8a-4bd4-af84-1c0396d16b3a', '3466fc06-ab5a-4778-8bc2-abaaf3b47d14'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:32 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Delete snapshot completed successfully. Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-26306ff8-4002-4d36-bcdf-54580ab10545 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-0aa004aa-39eb-49b2-8727-85f96ad73bd8-delete_snapshot" released by "delete_snapshot" :: held 2.996s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:32 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.624s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:32 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb Feb 24 11:03:32 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-497517aa-14cd-45b7-823d-4ff02710e125-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Lock "cinder-497517aa-14cd-45b7-823d-4ff02710e125-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-bd98bccc-3018-4dbb-bb4e-cad895006518-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-bd98bccc-3018-4dbb-bb4e-cad895006518-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-497517aa-14cd-45b7-823d-4ff02710e125" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-497517aa-14cd-45b7-823d-4ff02710e125" acquired by "delete_volume" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbfa7c0-1d3f-44f7-b9e0-09d7edae027d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-bd98bccc-3018-4dbb-bb4e-cad895006518" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-bd98bccc-3018-4dbb-bb4e-cad895006518" acquired by "delete_volume" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f0d551-b9d6-4699-825d-e0dd13560bd7]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:32 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 Feb 24 11:03:32 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:32 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 Feb 24 11:03:32 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:33 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb" returned: 0 in 1.103s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:33 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125" returned: 0 in 0.695s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:33 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb Feb 24 11:03:33 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:33 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125 Feb 24 11:03:33 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:33 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518" returned: 0 in 0.927s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:33 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518 Feb 24 11:03:33 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:34 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-497517aa-14cd-45b7-823d-4ff02710e125" returned: 0 in 0.625s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-497517aa-14cd-45b7-823d-4ff02710e125" released by "delete_volume" :: held 1.391s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:34 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:03:34 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Created reservations ['96eec83f-70cc-4702-a8b9-0603984d45bc', '7f5fdba1-ce9f-4799-bd75-dc49fd8c9cef', '2fc6949f-dbd9-465e-98a5-148fe15bdacb', 'c47b986a-cb3f-4b9a-bd5f-d9c0c4aad82e'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:34 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:03:34 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:34 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.5aadcbb2-f175-44ed-b422-615751ea7ecb" returned: 0 in 1.108s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-5aadcbb2-f175-44ed-b422-615751ea7ecb" released by "_delete_snapshot" :: held 3.980s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" released by "delete_snapshot" :: held 4.000s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Created reservations ['0fbd4226-688f-43d3-98a5-2bccef6484cc', '6ac4895a-2970-4376-bb19-67b03577cdff', '19f759d2-36fa-43f9-af82-ce404a39b761', '3e671a64-c740-450c-85d5-cd5425d11bff'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:34 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd98bccc-3018-4dbb-bb4e-cad895006518" returned: 0 in 0.892s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-bd98bccc-3018-4dbb-bb4e-cad895006518" released by "delete_volume" :: held 1.913s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:34 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.667s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:03:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Delete snapshot completed successfully. Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e7eb3157-3fe2-4802-bc77-fe98f44a7de2 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-5aadcbb2-f175-44ed-b422-615751ea7ecb-delete_snapshot" released by "delete_snapshot" :: held 4.249s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Created reservations ['e84d2b31-337c-4e26-abbe-4a10333fd15a', '6c6ed849-e8c8-4e80-97b0-619433ac0874', '148a720d-25f5-4b7c-a3f1-4afa9862d12b', '0a0072cc-fa8a-4c08-9459-65a93c39eff8'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-ded48ddd-56d3-4675-9f43-76c35821ddea-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Lock "cinder-ded48ddd-56d3-4675-9f43-76c35821ddea-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:34 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:03:34 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-ded48ddd-56d3-4675-9f43-76c35821ddea" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-ded48ddd-56d3-4675-9f43-76c35821ddea" acquired by "delete_volume" :: waited 0.006s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[618ccbe5-b2c7-4c91-a216-7c74f7ee5d16]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:35 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea Feb 24 11:03:35 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Creating offline snapshot bc7145ee-25d9-48bc-a392-b26ba088b849 of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:03:35 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.959s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba5947-7bc3-41bb-9934-6d90f08b59de]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:35 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Deleted volume successfully. Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0b9d2aed-3be6-47ed-929d-81b342edc665 tempest-VolumesGetTest-2116324429 None] Lock "cinder-497517aa-14cd-45b7-823d-4ff02710e125-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:35 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:03:35 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:35 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.726s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:03:35 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Deleted volume successfully. Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-df9abe8b-3ca1-41df-9819-2c4eb4300cdb tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-bd98bccc-3018-4dbb-bb4e-cad895006518-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:35 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea" returned: 0 in 0.670s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:35 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea Feb 24 11:03:35 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:35 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.643s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:35 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 1G Feb 24 11:03:35 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:36 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ded48ddd-56d3-4675-9f43-76c35821ddea" returned: 0 in 0.580s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-ded48ddd-56d3-4675-9f43-76c35821ddea" released by "delete_volume" :: held 1.277s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (59938cb7-024a-442e-b5cf-b054c2deb882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b7324f-143e-443d-a7b7-81f2facd060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b7324f-143e-443d-a7b7-81f2facd060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1026446429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1db80b2-2963-40d8-b9a5-0760760c837b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3a298a16c646e2ad9928a46b958864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:36Z,use_quota=True,user_id='1b16a0fce28f445aa023b3c31b0726ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4a7e63-5fa6-415a-be3f-d290126b6a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4a7e63-5fa6-415a-be3f-d290126b6a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3f045b-00c5-43a7-b6dc-f2c8418ac45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3f045b-00c5-43a7-b6dc-f2c8418ac45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1db80b2-2963-40d8-b9a5-0760760c837b', 'volume_name': 'volume-b1db80b2-2963-40d8-b9a5-0760760c837b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f54c86-ef3b-425a-95d2-abe30034238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f54c86-ef3b-425a-95d2-abe30034238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c0deb3-2633-4bc5-9175-168ff7df2c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:36 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume b1db80b2-2963-40d8-b9a5-0760760c837b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1db80b2-2963-40d8-b9a5-0760760c837b', 'volume_size': 1} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Created reservations ['aea3d158-23f3-469e-9cfa-6f5da4935461', 'b045b441-d33c-4e7c-b303-a7de5a02d83c', '398d7535-8c0e-4229-b49d-ae13a81ad14c', '3c85ee53-7e3d-40b9-8134-fcbf546e5271'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:36 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:03:36 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:36 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 1G" returned: 0 in 0.693s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:36 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 Feb 24 11:03:36 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:36 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.480s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:03:36 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Deleted volume successfully. Feb 24 11:03:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5efe3af2-af0b-4473-92e6-c2bc6ec02348 tempest-VolumesGetTest-2116324429 None] Lock "cinder-ded48ddd-56d3-4675-9f43-76c35821ddea-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:37 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849" returned: 0 in 0.509s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:37 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 is being set with open permissions: ugo+rw Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:37 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 Feb 24 11:03:37 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (e82d55bc-cee3-4db6-868f-123bbaa7e6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a24b1e-9dea-4eae-8acd-2a7beff0fd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a24b1e-9dea-4eae-8acd-2a7beff0fd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1998869725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f5ae4f-6065-4c4c-a50e-3229037edee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:37Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3960ad-c382-4d66-8224-0b45d033320f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3960ad-c382-4d66-8224-0b45d033320f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e90c902-2e74-4660-9eb9-600f71690bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e90c902-2e74-4660-9eb9-600f71690bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f5ae4f-6065-4c4c-a50e-3229037edee4', 'volume_name': 'volume-55f5ae4f-6065-4c4c-a50e-3229037edee4', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a121db-5e8a-4f0f-b817-b48c7d7e5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a121db-5e8a-4f0f-b817-b48c7d7e5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67834b3-88d0-4479-b2db-5ab38420cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:37 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Volume 55f5ae4f-6065-4c4c-a50e-3229037edee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f5ae4f-6065-4c4c-a50e-3229037edee4', 'volume_size': 1} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:37 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849" returned: 0 in 0.543s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.287s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1026446429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1db80b2-2963-40d8-b9a5-0760760c837b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3a298a16c646e2ad9928a46b958864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:36Z,use_quota=True,user_id='1b16a0fce28f445aa023b3c31b0726ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Creating volume b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:37 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:03:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:37 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b 1073741824 Feb 24 11:03:37 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:37 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d5f5b0ff-e384-47ce-90ae-a2498fea82c4 tempest-SnapshotsActionsTest-1422410947 None] Create snapshot completed successfully Feb 24 11:03:38 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b 1073741824" returned: 0 in 0.553s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:38 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b Feb 24 11:03:38 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-bc7145ee-25d9-48bc-a392-b26ba088b849-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-bc7145ee-25d9-48bc-a392-b26ba088b849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-quobyte-bc7145ee-25d9-48bc-a392-b26ba088b849" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-bc7145ee-25d9-48bc-a392-b26ba088b849" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Deleting offline snapshot bc7145ee-25d9-48bc-a392-b26ba088b849 of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] snapshot_file for this snap is: volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5effddad-7684-4712-a1fd-349ba8a4fd15]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:38 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 Feb 24 11:03:38 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:38 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b" returned: 0 in 0.520s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1998869725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f5ae4f-6065-4c4c-a50e-3229037edee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:37Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Creating volume 55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:38 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c0deb3-2633-4bc5-9175-168ff7df2c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1db80b2-2963-40d8-b9a5-0760760c837b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f283cd-5ff6-427f-8edf-912f02d764c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:38 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 1073741824 Feb 24 11:03:38 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:38 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume volume-b1db80b2-2963-40d8-b9a5-0760760c837b (b1db80b2-2963-40d8-b9a5-0760760c837b): created successfully Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f283cd-5ff6-427f-8edf-912f02d764c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (59938cb7-024a-442e-b5cf-b054c2deb882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:38 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-94ae7c4e-3646-485e-8606-f6c9ee0fa252 tempest-VolumesSnapshotTestJSON-1549974402 None] Created volume successfully. Feb 24 11:03:39 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849" returned: 0 in 1.239s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:39 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9e6496-fc6f-4d69-b040-a741b7c0261d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:39 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:03:39 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:40 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 1073741824" returned: 0 in 1.385s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:40 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 Feb 24 11:03:40 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:40 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.562s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:40 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 Feb 24 11:03:40 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:40 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4" returned: 0 in 0.627s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.974s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67834b3-88d0-4479-b2db-5ab38420cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f5ae4f-6065-4c4c-a50e-3229037edee4', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a011b1c5-bd72-45cc-b4cc-5cdf8d12a616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:40 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Volume volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 (55f5ae4f-6065-4c4c-a50e-3229037edee4): created successfully Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a011b1c5-bd72-45cc-b4cc-5cdf8d12a616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (e82d55bc-cee3-4db6-868f-123bbaa7e6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Creating offline snapshot 86931cea-0995-4987-a31e-58e12fcb777e of volume b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:03:40 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3a32172b-9b5b-40c6-ad77-c1a87a6e30ef tempest-VolumesGetTest-2116324429 None] Created volume successfully. Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[27074a7c-fe29-4a73-9395-4611d8f83f94]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:41 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b Feb 24 11:03:41 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:41 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849" returned: 0 in 0.793s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:41 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849 Feb 24 11:03:41 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Flow 'volume_create_manager' (c146e324-6da0-451c-8981-6b582ab60ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45826c1b-e313-4455-8519-9feceaa2d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45826c1b-e313-4455-8519-9feceaa2d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-301984853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20c8a35-37ab-4ba2-b42d-61cb309bf4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='915bb6d29dcb42b6829f5399e9d168f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:41Z,use_quota=True,user_id='9c0e469af72640669df971a10e144079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453f3d5a-2684-4225-8eb2-1728abaac840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453f3d5a-2684-4225-8eb2-1728abaac840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37018912-c2bd-418c-b649-8158bc7740af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37018912-c2bd-418c-b649-8158bc7740af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20c8a35-37ab-4ba2-b42d-61cb309bf4de', 'volume_name': 'volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701c3319-774c-42cb-8fe2-5c33a4250e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701c3319-774c-42cb-8fe2-5c33a4250e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2698a1b-6c23-4180-b20d-0205557c09d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:41 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Volume c20c8a35-37ab-4ba2-b42d-61cb309bf4de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de', 'volume_size': 1} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:41 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b" returned: 0 in 0.738s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:41 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e 1G Feb 24 11:03:41 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:41 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.bc7145ee-25d9-48bc-a392-b26ba088b849" returned: 0 in 0.567s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-bc7145ee-25d9-48bc-a392-b26ba088b849" released by "_delete_snapshot" :: held 3.249s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" released by "delete_snapshot" :: held 3.263s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:41 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Created reservations ['d63d1d43-d879-455f-9c2c-fa7745bd8f5c', '8f0a75ec-b02f-4640-bd09-8fe9e495454c', 'e3e87e5f-e8f5-4cb5-9f7f-a861336932f0', '5a44a44e-e14a-4b9b-97bc-dbb6b9390749'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:03:41 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Delete snapshot completed successfully. Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d8fb76d7-bdde-44f6-8664-9bf667574464 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-bc7145ee-25d9-48bc-a392-b26ba088b849-delete_snapshot" released by "delete_snapshot" :: held 3.458s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (4c4d7b3f-c1d4-4de5-b102-47b6b62e3003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68ae8e3-fdc4-4176-8810-281ff24f6cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68ae8e3-fdc4-4176-8810-281ff24f6cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-342871534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e5cffd-1824-4d49-a9b3-7752f36d8829,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=55f5ae4f-6065-4c4c-a50e-3229037edee4,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:42Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307989ab-ba23-4fa1-9014-f5e11989f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307989ab-ba23-4fa1-9014-f5e11989f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d7e421-c561-447e-91ec-260d99aa2d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d7e421-c561-447e-91ec-260d99aa2d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '92e5cffd-1824-4d49-a9b3-7752f36d8829', 'volume_name': 'volume-92e5cffd-1824-4d49-a9b3-7752f36d8829', 'volume_size': 1, 'source_volid': '55f5ae4f-6065-4c4c-a50e-3229037edee4', 'source_volstatus': 'available'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81aea662-474c-427a-afe3-bc11db8bd53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81aea662-474c-427a-afe3-bc11db8bd53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a4b348-4b75-4a7e-a4da-cbba82d639f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:42 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Volume 92e5cffd-1824-4d49-a9b3-7752f36d8829: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-92e5cffd-1824-4d49-a9b3-7752f36d8829', 'volume_size': 1, 'source_volid': '55f5ae4f-6065-4c4c-a50e-3229037edee4', 'source_volstatus': 'available'} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:42 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e 1G" returned: 0 in 0.709s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1db80b2-2963-40d8-b9a5-0760760c837b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:42 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1db80b2-2963-40d8-b9a5-0760760c837b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e Feb 24 11:03:42 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:42 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1db80b2-2963-40d8-b9a5-0760760c837b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e" returned: 0 in 0.523s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:42 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e is being set with open permissions: ugo+rw Feb 24 11:03:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:42 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e Feb 24 11:03:42 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:43 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e" returned: 0 in 0.507s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:43 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.info Feb 24 11:03:43 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:43 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.info" returned: 0 in 0.478s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:43 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.info is being set with open permissions: ugo+rw Feb 24 11:03:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:43 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.info Feb 24 11:03:43 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:44 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.info" returned: 0 in 0.476s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.580s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.794s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-301984853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20c8a35-37ab-4ba2-b42d-61cb309bf4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='915bb6d29dcb42b6829f5399e9d168f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:41Z,use_quota=True,user_id='9c0e469af72640669df971a10e144079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Creating volume c20c8a35-37ab-4ba2-b42d-61cb309bf4de {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:44 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:44 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-45182e02-0cad-4497-b501-9ce1e9fd1eea tempest-VolumesSnapshotTestJSON-1549974402 None] Create snapshot completed successfully Feb 24 11:03:44 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de 1073741824 Feb 24 11:03:44 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:44 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de 1073741824" returned: 0 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:44 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de Feb 24 11:03:44 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (983699d8-b56c-4cfe-8fb1-28320febb394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab48a301-742e-4704-ba37-a0e0099a0699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab48a301-742e-4704-ba37-a0e0099a0699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-752897442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8628cd94-0f55-406f-ab10-7ed72a20e5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3a298a16c646e2ad9928a46b958864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=86931cea-0995-4987-a31e-58e12fcb777e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:45Z,use_quota=True,user_id='1b16a0fce28f445aa023b3c31b0726ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c6ad0c-ba7e-4823-bd9f-4656f58acc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c6ad0c-ba7e-4823-bd9f-4656f58acc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356364d2-3eec-4c32-acc9-b912e7597ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356364d2-3eec-4c32-acc9-b912e7597ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8628cd94-0f55-406f-ab10-7ed72a20e5b2', 'volume_name': 'volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2', 'volume_size': 1, 'snapshot_id': '86931cea-0995-4987-a31e-58e12fcb777e'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8920318-85b4-41a6-998c-462967c41d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8920318-85b4-41a6-998c-462967c41d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b996620-8786-46be-a661-3ff85f9a8e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:45 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume 8628cd94-0f55-406f-ab10-7ed72a20e5b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2', 'volume_size': 1, 'snapshot_id': '86931cea-0995-4987-a31e-58e12fcb777e'} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:45 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de" returned: 0 in 0.504s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.212s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:45 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Cloning volume 55f5ae4f-6065-4c4c-a50e-3229037edee4 to volume 92e5cffd-1824-4d49-a9b3-7752f36d8829 Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2698a1b-6c23-4180-b20d-0205557c09d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb95af63-61c6-4042-95c6-0d0c6c7f59e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:45 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Volume volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de (c20c8a35-37ab-4ba2-b42d-61cb309bf4de): created successfully Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb95af63-61c6-4042-95c6-0d0c6c7f59e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Flow 'volume_create_manager' (c146e324-6da0-451c-8981-6b582ab60ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:45 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b6be95bc-8529-49ec-8aed-e4fb11c8b9e2 tempest-ServerRescueNegativeTestJSON-858343878 None] Created volume successfully. Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Creating offline snapshot 14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 of volume 55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[41674b70-6b03-4534-ae1c-728d1577df3f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:45 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 Feb 24 11:03:45 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:46 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4" returned: 0 in 0.536s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:46 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 1G Feb 24 11:03:46 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:46 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 1G" returned: 0 in 0.552s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:46 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 Feb 24 11:03:46 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:47 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" returned: 0 in 0.506s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:47 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 is being set with open permissions: ugo+rw Feb 24 11:03:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:47 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 Feb 24 11:03:47 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:47 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" returned: 0 in 0.528s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:47 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.info Feb 24 11:03:47 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:48 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.info" returned: 0 in 0.416s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:48 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.info is being set with open permissions: ugo+rw Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:48 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.info Feb 24 11:03:48 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:48 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.info" returned: 0 in 0.447s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-92e5cffd-1824-4d49-a9b3-7752f36d8829" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-92e5cffd-1824-4d49-a9b3-7752f36d8829" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] snapshot: 14bf6f7f-9b55-4bff-b41f-48ddae16dcb4, volume: 92e5cffd-1824-4d49-a9b3-7752f36d8829, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca73d9c-9ebf-4840-b84c-a648979a4c6f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:48 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 Feb 24 11:03:48 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:49 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" returned: 0 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55f5ae4f-6065-4c4c-a50e-3229037edee4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cdfde1-d0cb-4349-b54f-c00dd5913794]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:49 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 Feb 24 11:03:49 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:49 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4" returned: 0 in 0.711s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:03:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:49 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 Feb 24 11:03:49 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:52 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829" returned: 0 in 2.460s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:52 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9384dbd8-8064-4077-bb62-7bf326ef559e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:52 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 Feb 24 11:03:52 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:53 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4" returned: 0 in 0.669s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:03:53 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Converted 1024.00 MB image at 416.08 MB/s Feb 24 11:03:53 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 is being set with open permissions: ugo+rw Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:53 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 Feb 24 11:03:53 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:53 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829" returned: 0 in 0.412s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-92e5cffd-1824-4d49-a9b3-7752f36d8829" released by "_copy_volume_from_snapshot" :: held 4.845s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Deleting offline snapshot 14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 of volume 55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] snapshot_file for this snap is: volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa919504-51dc-4d7c-855c-7d0c9a627149]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:53 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 Feb 24 11:03:53 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:54 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" returned: 0 in 0.546s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55f5ae4f-6065-4c4c-a50e-3229037edee4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb1c5f0-003b-4e2e-be6f-5a2291eee949]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:54 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 Feb 24 11:03:54 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:54 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4" returned: 0 in 0.506s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:54 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 Feb 24 11:03:54 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:55 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" returned: 0 in 0.592s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:55 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4 Feb 24 11:03:55 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:55 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4.14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" returned: 0 in 0.576s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-14bf6f7f-9b55-4bff-b41f-48ddae16dcb4" released by "_delete_snapshot" :: held 2.313s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.334s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.682s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a4b348-4b75-4a7e-a4da-cbba82d639f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e5cffd-1824-4d49-a9b3-7752f36d8829', 'volume_size': 1, 'source_volid': '55f5ae4f-6065-4c4c-a50e-3229037edee4', 'source_volstatus': 'available'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4c7c5d-597e-43a5-9c1d-b15bd95e4e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Creating offline snapshot f29b606d-43ab-43ea-bed5-74b7ace06548 of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:03:55 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Volume volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 (92e5cffd-1824-4d49-a9b3-7752f36d8829): created successfully Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4c7c5d-597e-43a5-9c1d-b15bd95e4e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (4c4d7b3f-c1d4-4de5-b102-47b6b62e3003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea0566-17ce-4fa2-bb96-08ef7dbff459]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:55 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-85903910-2916-429a-9f0e-735059b08356 tempest-VolumesGetTest-2116324429 None] Created volume successfully. Feb 24 11:03:55 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:03:55 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:56 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.604s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:56 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 1G Feb 24 11:03:56 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:56 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:03:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (94ac9640-3412-481f-9782-b96891cde633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:03:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac53ec5e-6f77-48c5-a3d1-b8ad8ae7ca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac53ec5e-6f77-48c5-a3d1-b8ad8ae7ca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1953346349',display_name='tempest-VolumesGetTest-Volume-1779073881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2959c5b2-4fd8-4d97-8d40-b26b7c7da14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:57Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff27b260-10ab-4a8e-98d9-b22e30fdb4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff27b260-10ab-4a8e-98d9-b22e30fdb4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded03a06-c96a-486d-8572-0e65e6d43487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded03a06-c96a-486d-8572-0e65e6d43487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2959c5b2-4fd8-4d97-8d40-b26b7c7da14b', 'volume_name': 'volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edd6356-046f-4119-b6f7-e08c743a7be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edd6356-046f-4119-b6f7-e08c743a7be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b7fc9-38e1-4d68-a98a-5d069d381bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:03:57 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Volume 2959c5b2-4fd8-4d97-8d40-b26b7c7da14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b', 'volume_size': 1} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:57 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 1G" returned: 0 in 0.896s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:57 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 Feb 24 11:03:57 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:57 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548" returned: 0 in 0.472s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:57 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 is being set with open permissions: ugo+rw Feb 24 11:03:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:57 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 Feb 24 11:03:57 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:58 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548" returned: 0 in 0.458s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.968s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-86931cea-0995-4987-a31e-58e12fcb777e-8628cd94-0f55-406f-ab10-7ed72a20e5b2" by "_create_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8374626d-b2c0-4bff-b94e-c45584f1b9ec tempest-SnapshotsActionsTest-1422410947 None] Create snapshot completed successfully Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-86931cea-0995-4987-a31e-58e12fcb777e-8628cd94-0f55-406f-ab10-7ed72a20e5b2" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Creating volume 8628cd94-0f55-406f-ab10-7ed72a20e5b2 from snapshot 86931cea-0995-4987-a31e-58e12fcb777e {{(pid=82627) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-8628cd94-0f55-406f-ab10-7ed72a20e5b2" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-8628cd94-0f55-406f-ab10-7ed72a20e5b2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] snapshot: 86931cea-0995-4987-a31e-58e12fcb777e, volume: 8628cd94-0f55-406f-ab10-7ed72a20e5b2, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8442b89-38a9-4758-9b9e-978845b9116a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:58 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e Feb 24 11:03:58 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-f29b606d-43ab-43ea-bed5-74b7ace06548-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-f29b606d-43ab-43ea-bed5-74b7ace06548-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-quobyte-f29b606d-43ab-43ea-bed5-74b7ace06548" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-f29b606d-43ab-43ea-bed5-74b7ace06548" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Deleting offline snapshot f29b606d-43ab-43ea-bed5-74b7ace06548 of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] snapshot_file for this snap is: volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b8ac7-da6d-4eb2-b7fd-c28748601435]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:58 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 Feb 24 11:03:58 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:59 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e" returned: 0 in 0.571s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1db80b2-2963-40d8-b9a5-0760760c837b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3179e9-7aae-46da-971e-9c1f0ff978d5]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:59 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b Feb 24 11:03:59 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:59 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548" returned: 0 in 0.570s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b46852a-b970-4c25-8a92-64253c83d8b2]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:59 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:03:59 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:03:59 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b" returned: 0 in 0.575s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:03:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:03:59 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 Feb 24 11:03:59 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:00 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.857s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:00 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 Feb 24 11:04:00 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:02 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548" returned: 0 in 2.362s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:02 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548 Feb 24 11:04:02 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:03 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2" returned: 0 in 4.263s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb92867f-3904-43d3-9b65-f36512401639]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Acquiring lock "cinder-c20c8a35-37ab-4ba2-b42d-61cb309bf4de-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "cinder-c20c8a35-37ab-4ba2-b42d-61cb309bf4de-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Acquiring lock "cinder-quobyte-c20c8a35-37ab-4ba2-b42d-61cb309bf4de" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "cinder-quobyte-c20c8a35-37ab-4ba2-b42d-61cb309bf4de" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:04 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b Feb 24 11:04:04 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:04 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.f29b606d-43ab-43ea-bed5-74b7ace06548" returned: 0 in 1.522s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a7c9ab-4375-418d-91f5-349c0d2a6c1e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-f29b606d-43ab-43ea-bed5-74b7ace06548" released by "_delete_snapshot" :: held 5.414s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" released by "delete_snapshot" :: held 5.431s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Created reservations ['fc23a103-00cd-44ed-8a6b-5e770fa1cae0', 'a5fe1bdd-a785-4837-949c-bcd1ec90323b', '0ba3b0df-8862-489a-aadb-14db2a49d025', '359fe469-8f20-4e09-911b-2d941c1518b2'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:04 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Delete snapshot completed successfully. Feb 24 11:04:04 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de Feb 24 11:04:04 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-423d205e-a0dc-4775-b14b-f29509846324 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-f29b606d-43ab-43ea-bed5-74b7ace06548-delete_snapshot" released by "delete_snapshot" :: held 5.585s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:04 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b" returned: 0 in 0.713s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:04:04 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Converted 1024.00 MB image at 240.13 MB/s Feb 24 11:04:04 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 is being set with open permissions: ugo+rw Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:04 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 Feb 24 11:04:04 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:04 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de" returned: 0 in 0.619s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:04 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de Feb 24 11:04:04 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:05 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c20c8a35-37ab-4ba2-b42d-61cb309bf4de" returned: 0 in 0.490s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "cinder-quobyte-c20c8a35-37ab-4ba2-b42d-61cb309bf4de" released by "delete_volume" :: held 1.192s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Created reservations ['3521dba4-1b01-4b56-a99f-112e0960da3b', '5a0d6497-fa3c-4f89-b974-3a4d1bd2e22d', '7afcaba2-70f4-4b87-8ff4-00b6730e43e8', '6380d3fd-4686-48bd-b816-f72bf8573aaf'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:05 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2" returned: 0 in 0.702s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:05 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:05 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-8628cd94-0f55-406f-ab10-7ed72a20e5b2" released by "_copy_volume_from_snapshot" :: held 7.040s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-86931cea-0995-4987-a31e-58e12fcb777e-8628cd94-0f55-406f-ab10-7ed72a20e5b2" released by "_create_volume_from_snapshot" :: held 7.066s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.093s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.423s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:03:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1953346349',display_name='tempest-VolumesGetTest-Volume-1779073881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2959c5b2-4fd8-4d97-8d40-b26b7c7da14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:03:57Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Creating volume 2959c5b2-4fd8-4d97-8d40-b26b7c7da14b {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:05 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:05 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b 1073741824 Feb 24 11:04:05 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b996620-8786-46be-a661-3ff85f9a8e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2', 'volume_size': 1, 'snapshot_id': '86931cea-0995-4987-a31e-58e12fcb777e'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9c24ce-ce64-42f4-bac0-36d1837473c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:05 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Volume volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 (8628cd94-0f55-406f-ab10-7ed72a20e5b2): created successfully Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9c24ce-ce64-42f4-bac0-36d1837473c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Flow 'volume_create_manager' (983699d8-b56c-4cfe-8fb1-28320febb394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:05 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-76bdf8df-5570-4cf3-a485-2b1deab32079 tempest-VolumesSnapshotTestJSON-1549974402 None] Created volume successfully. Feb 24 11:04:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:06 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.598s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:06 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Deleted volume successfully. Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55e6c216-11d4-4088-a0d9-6cb40c789916 tempest-ServerRescueNegativeTestJSON-858343878 None] Lock "cinder-c20c8a35-37ab-4ba2-b42d-61cb309bf4de-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:06 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b 1073741824" returned: 0 in 0.673s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:06 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b Feb 24 11:04:06 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-8628cd94-0f55-406f-ab10-7ed72a20e5b2-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-8628cd94-0f55-406f-ab10-7ed72a20e5b2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-8628cd94-0f55-406f-ab10-7ed72a20e5b2" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-8628cd94-0f55-406f-ab10-7ed72a20e5b2" acquired by "delete_volume" :: waited 0.022s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a099fe0-616a-44a6-991d-43fa9e2c5ced]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:06 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 Feb 24 11:04:06 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:06 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b" returned: 0 in 0.598s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.117s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Creating offline snapshot b9e37033-2e4b-487e-9151-6bae24e351db of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b7fc9-38e1-4d68-a98a-5d069d381bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e167d1f-2451-434f-8101-496cf2415825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7515b9e0-3965-46c2-86ab-d881c9b7c548]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:06 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Volume volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b (2959c5b2-4fd8-4d97-8d40-b26b7c7da14b): created successfully Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e167d1f-2451-434f-8101-496cf2415825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:06 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (94ac9640-3412-481f-9782-b96891cde633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:06 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7ff557c3-66d2-474c-b8d1-06fa93aefe13 tempest-VolumesGetTest-2116324429 None] Created volume successfully. Feb 24 11:04:06 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:04:06 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:07 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2" returned: 0 in 0.763s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:07 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2 Feb 24 11:04:07 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Lock "cinder-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b" acquired by "delete_volume" :: waited 0.022s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f767a6-adf0-4bb6-a918-73615bccbd7d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:07 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-8628cd94-0f55-406f-ab10-7ed72a20e5b2" returned: 0 in 0.479s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-8628cd94-0f55-406f-ab10-7ed72a20e5b2" released by "delete_volume" :: held 1.277s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:07 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b Feb 24 11:04:07 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Created reservations ['d41300f7-4ecc-4fe7-9fa6-11bb8681afbc', '96e85760-1ab9-4d0b-bf24-ad1e5665c0c1', 'b2e80bba-d91c-4018-b86e-a3cac0337b5c', 'da21bb80-4e7c-43e5-bcb6-bea6bcf69cf4'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:07 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:07 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:08 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 1.227s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:08 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db 1G Feb 24 11:04:08 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:08 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b" returned: 0 in 0.913s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:08 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b Feb 24 11:04:08 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-86931cea-0995-4987-a31e-58e12fcb777e-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:08 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.854s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:08 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Deleted volume successfully. Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-86931cea-0995-4987-a31e-58e12fcb777e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-b1db80b2-2963-40d8-b9a5-0760760c837b" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a8f2c2e2-4612-4f35-8aaf-7290232d4640 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-8628cd94-0f55-406f-ab10-7ed72a20e5b2-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-b1db80b2-2963-40d8-b9a5-0760760c837b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-86931cea-0995-4987-a31e-58e12fcb777e" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-86931cea-0995-4987-a31e-58e12fcb777e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Deleting offline snapshot 86931cea-0995-4987-a31e-58e12fcb777e of volume b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] snapshot_file for this snap is: volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7744aa6-105d-4f16-a474-31bc81c29441]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:08 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e Feb 24 11:04:08 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:08 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db 1G" returned: 0 in 0.814s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:08 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db Feb 24 11:04:08 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:09 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b" returned: 0 in 0.700s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b" released by "delete_volume" :: held 1.704s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Created reservations ['6c0c0000-a582-4c0b-95e4-d9f49ea9d2c8', '1d81dee7-c743-4ce7-b694-3ad059a76885', '9e8fad3a-221b-47b1-8b46-44d5eb53bd6a', '8196f3c8-0b72-4c92-8119-15cb919dbf00'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:09 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:09 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:09 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e" returned: 0 in 0.605s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1db80b2-2963-40d8-b9a5-0760760c837b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b1973f-c2bc-4954-aa15-5bd2337ff5a0]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:09 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b Feb 24 11:04:09 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:09 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db" returned: 0 in 0.715s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:09 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db is being set with open permissions: ugo+rw Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:09 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db Feb 24 11:04:09 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-92e5cffd-1824-4d49-a9b3-7752f36d8829-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Lock "cinder-92e5cffd-1824-4d49-a9b3-7752f36d8829-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-92e5cffd-1824-4d49-a9b3-7752f36d8829" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-92e5cffd-1824-4d49-a9b3-7752f36d8829" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ab1f33-8e5c-48c0-a8c2-1c568a93a5bf]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:10 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.744s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:10 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Deleted volume successfully. Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7ae8d89f-afdc-4a4f-92c9-7169e0d83aa5 tempest-VolumesGetTest-2116324429 None] Lock "cinder-2959c5b2-4fd8-4d97-8d40-b26b7c7da14b-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:10 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 Feb 24 11:04:10 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:10 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b" returned: 0 in 0.896s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:10 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e Feb 24 11:04:10 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:10 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db" returned: 0 in 0.708s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.555s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:10 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0400a546-ecad-4975-852a-030d1791f775 tempest-SnapshotsActionsTest-1422410947 None] Create snapshot completed successfully Feb 24 11:04:10 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829" returned: 0 in 0.593s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:10 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829 Feb 24 11:04:10 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:10 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e" returned: 0 in 0.512s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:10 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e Feb 24 11:04:10 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:11 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-92e5cffd-1824-4d49-a9b3-7752f36d8829" returned: 0 in 0.535s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-92e5cffd-1824-4d49-a9b3-7752f36d8829" released by "delete_volume" :: held 1.155s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-b9e37033-2e4b-487e-9151-6bae24e351db-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-b9e37033-2e4b-487e-9151-6bae24e351db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Acquiring lock "cinder-quobyte-b9e37033-2e4b-487e-9151-6bae24e351db" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Created reservations ['85865dcc-6410-4463-b9a9-99c84050abf3', 'be6fda6a-d59c-4059-809a-129e8dabe4db', 'e107665e-033b-4191-b676-760d816f74b5', 'f837501e-acb2-4bb3-845f-8d4d96c22e1e'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-b9e37033-2e4b-487e-9151-6bae24e351db" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Deleting offline snapshot b9e37033-2e4b-487e-9151-6bae24e351db of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] snapshot_file for this snap is: volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[de783ec3-964f-43f6-9634-ccfd2e5a5b80]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:11 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:11 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:11 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b.86931cea-0995-4987-a31e-58e12fcb777e" returned: 0 in 0.535s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:11 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db Feb 24 11:04:11 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-86931cea-0995-4987-a31e-58e12fcb777e" released by "_delete_snapshot" :: held 2.613s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-b1db80b2-2963-40d8-b9a5-0760760c837b" released by "delete_snapshot" :: held 2.625s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Created reservations ['3d23aa11-3268-4d8c-a760-9059de37640b', '7a7d86fa-a8bf-4592-acf1-425858ccf56d', '7a82e072-42b8-43ab-aa27-55d2ff06265c', '44222be0-47ab-43f5-8a0e-06503629cc07'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Delete snapshot completed successfully. Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-00c47d3e-0403-4a48-99e2-982bc96bf543 tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-86931cea-0995-4987-a31e-58e12fcb777e-delete_snapshot" released by "delete_snapshot" :: held 2.748s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:11 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.502s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Deleted volume successfully. Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c77236f0-bde7-4d36-bda4-220ec160db1e tempest-VolumesGetTest-2116324429 None] Lock "cinder-92e5cffd-1824-4d49-a9b3-7752f36d8829-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:11 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db" returned: 0 in 0.625s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdc4d54-0e15-4b1a-8c75-1a21daafd594]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:11 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:04:11 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-b1db80b2-2963-40d8-b9a5-0760760c837b-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-b1db80b2-2963-40d8-b9a5-0760760c837b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-b1db80b2-2963-40d8-b9a5-0760760c837b" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-b1db80b2-2963-40d8-b9a5-0760760c837b" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7649a8c-c083-437a-a95b-a71b816c03fa]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:12 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b Feb 24 11:04:12 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-55f5ae4f-6065-4c4c-a50e-3229037edee4-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Lock "cinder-55f5ae4f-6065-4c4c-a50e-3229037edee4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-55f5ae4f-6065-4c4c-a50e-3229037edee4" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-55f5ae4f-6065-4c4c-a50e-3229037edee4" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a3c69-3981-4c97-b027-30d26fabccb5]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:12 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 Feb 24 11:04:12 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:12 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.666s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:12 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db Feb 24 11:04:12 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:12 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b" returned: 0 in 0.690s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:12 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b Feb 24 11:04:12 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:12 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4" returned: 0 in 0.641s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:12 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4 Feb 24 11:04:12 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:13 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db" returned: 0 in 0.620s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:13 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db Feb 24 11:04:13 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:13 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b1db80b2-2963-40d8-b9a5-0760760c837b" returned: 0 in 0.540s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-b1db80b2-2963-40d8-b9a5-0760760c837b" released by "delete_volume" :: held 1.274s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Created reservations ['c4d80726-f5fc-4aee-a42a-19ba39b8a8ac', '597c5963-dde1-4234-a6ac-12237ebea6da', '6b4a1b37-4418-4409-b3f5-19d3b1156470', 'aa836ffa-f28d-4e10-a0cb-9dd707c37d90'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:13 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-55f5ae4f-6065-4c4c-a50e-3229037edee4" returned: 0 in 0.562s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:13 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:13 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-55f5ae4f-6065-4c4c-a50e-3229037edee4" released by "delete_volume" :: held 1.262s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Created reservations ['06117a49-8871-4639-a991-642bedec09ae', '19b76124-fd07-431c-9447-1aa165abd957', '69d54106-baa2-469f-9d12-432747d75311', 'b9093e25-6593-49a0-ab05-7ceb8a121643'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:13 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:13 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:13 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.b9e37033-2e4b-487e-9151-6bae24e351db" returned: 0 in 0.693s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-b9e37033-2e4b-487e-9151-6bae24e351db" released by "_delete_snapshot" :: held 2.671s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" released by "delete_snapshot" :: held 2.704s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Created reservations ['5cde895d-cd91-4366-9a0f-80b7617910b1', 'c8d42a0a-a6fe-4bbd-a1d3-2ca22f7d0574', 'a882fa5c-71d0-40b4-8802-bac80a485568', '31449083-7c8a-4e75-bfaa-39c918a5cca4'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Delete snapshot completed successfully. Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-65dce170-a370-40cd-bd64-997e5503e5d7 tempest-SnapshotsActionsTest-716817111 None] Lock "cinder-b9e37033-2e4b-487e-9151-6bae24e351db-delete_snapshot" released by "delete_snapshot" :: held 2.825s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:13 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.490s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:13 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Deleted volume successfully. Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-73f20371-b128-4dee-8a01-775eba5bf07a tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-b1db80b2-2963-40d8-b9a5-0760760c837b-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:14 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.518s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:14 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Deleted volume successfully. Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "cinder-quobyte-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-72ba8751-6adc-4db3-b38a-4f60cd348447 tempest-VolumesGetTest-2116324429 None] Lock "cinder-55f5ae4f-6065-4c4c-a50e-3229037edee4-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84cbd91-4ed1-4525-a40c-bfdaf6351da1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:14 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 Feb 24 11:04:14 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "cinder-c5fb6060-a030-4f96-a241-d51811abd1b1-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-c5fb6060-a030-4f96-a241-d51811abd1b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "cinder-quobyte-c5fb6060-a030-4f96-a241-d51811abd1b1" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-quobyte-c5fb6060-a030-4f96-a241-d51811abd1b1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Deleting offline snapshot c5fb6060-a030-4f96-a241-d51811abd1b1 of volume 40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] snapshot_file for this snap is: volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cda651-d24f-4d48-bb0f-94bb5512dd5a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:14 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:04:14 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:14 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" returned: 0 in 0.743s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:15 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2 Feb 24 11:04:15 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (2cfb98b1-2f4a-4bf1-b28f-8ddbe4caabc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a49a59-ec9c-4abf-8910-fe94aacde313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a49a59-ec9c-4abf-8910-fe94aacde313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1095045623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091d4c47-0402-4254-84d8-2995d36be776,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:15Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f192d90b-6b2e-4e94-bb4f-c1163e525063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f192d90b-6b2e-4e94-bb4f-c1163e525063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdc9c76-16f8-48c0-8859-8f7f28f56558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.image.glance [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Creating Keystone auth plugin from conf {{(pid=82627) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdc9c76-16f8-48c0-8859-8f7f28f56558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '091d4c47-0402-4254-84d8-2995d36be776', 'volume_name': 'volume-091d4c47-0402-4254-84d8-2995d36be776', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452a484f-3de0-4861-b2a2-ab5c82558d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:15 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452a484f-3de0-4861-b2a2-ab5c82558d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce6a3a4-df6f-47d0-a120-922b1bf87ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:15 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Volume 091d4c47-0402-4254-84d8-2995d36be776: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-091d4c47-0402-4254-84d8-2995d36be776', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Trying to clone 091d4c47-0402-4254-84d8-2995d36be776 from image 4158f967-877e-452e-b5d3-debeeb743c37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]). {{(pid=82627) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.674s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b98fef7-9716-4495-a92e-40a2c759c606]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:15 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" returned: 0 in 0.496s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:15 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 Feb 24 11:04:15 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-quobyte-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2" released by "delete_volume" :: held 1.296s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 24 11:04:15 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Image download 20.69 MB at 20.69 MB/s Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Created reservations ['6c6bfab3-43ac-4442-b85d-bcfea0fa798b', '21133caa-f6b2-46b4-80e6-11f91b4fba41', '8b92da8e-cc73-4d6c-a0de-fd95511bdb48', '79fba1c9-4e4e-4a38-ae12-d95d5adf68de'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecee6f13-8717-422a-9a17-9af0c5b7ffa3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:15 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:15 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:15 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD Feb 24 11:04:15 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:15 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3" returned: 0 in 0.556s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:15 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:04:15 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:16 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.432s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:16 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Deleted volume successfully. Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c8d0855e-3251-47cb-bf5d-bbfe0b048e0b tempest-VolumesSnapshotTestJSON-1549974402 None] Lock "cinder-a4cc7b2a-aadc-4b42-bec0-8c939ad915a2-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:16 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD" returned: 0 in 0.617s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 is fetched for user 1aa65179698c460eaa961b1b1b37f88b. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0107bb71-f9b4-46d3-8438-01da7d06437a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:16 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD Feb 24 11:04:16 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:16 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.574s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:16 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1 Feb 24 11:04:16 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:16 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1095045623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091d4c47-0402-4254-84d8-2995d36be776,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:15Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Creating volume 091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:16 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:16 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 1073741824 Feb 24 11:04:16 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:17 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3.c5fb6060-a030-4f96-a241-d51811abd1b1" returned: 0 in 0.521s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-quobyte-c5fb6060-a030-4f96-a241-d51811abd1b1" released by "_delete_snapshot" :: held 2.392s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" released by "delete_snapshot" :: held 2.420s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Created reservations ['1e6b4680-0c83-419c-9f37-c513c49101ae', 'dafb6c38-0150-44ec-bb02-814c61487bf0', '685875c0-30a6-4a13-9b36-671a77e79708', '1dba6702-9422-4c6d-8329-8402674a765c'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:17 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Delete snapshot completed successfully. Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e3918fc7-cc64-4513-a1bc-84414f05183b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-c5fb6060-a030-4f96-a241-d51811abd1b1-delete_snapshot" released by "delete_snapshot" :: held 2.572s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:17 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 1073741824" returned: 0 in 0.613s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:17 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 Feb 24 11:04:17 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "cinder-40141d40-0ca2-4ce7-96cc-86807ffce8d3-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-40141d40-0ca2-4ce7-96cc-86807ffce8d3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1109e58-b046-44c8-8bac-26189fc3fdfc]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:17 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776" returned: 0 in 0.496s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:17 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Attempting download of 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume 091d4c47-0402-4254-84d8-2995d36be776. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0324a3b0-5cfe-4a6e-9e71-5c98adabb7d4]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_27j5k1z5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:18 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 Feb 24 11:04:18 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:18 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_27j5k1z5 Feb 24 11:04:18 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:18 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3" returned: 0 in 0.555s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:18 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3 Feb 24 11:04:18 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:18 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_27j5k1z5" returned: 0 in 0.526s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_27j5k1z5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:18 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_27j5k1z5 Feb 24 11:04:18 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:18 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-40141d40-0ca2-4ce7-96cc-86807ffce8d3" returned: 0 in 0.420s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-quobyte-40141d40-0ca2-4ce7-96cc-86807ffce8d3" released by "delete_volume" :: held 1.012s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=127,cinder:UPDATE=141,cinder:INSERT=48,cinder:DELETE=12 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=131,cinder:DELETE=14,cinder:UPDATE=182,cinder:INSERT=37 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:04:18 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Created reservations ['3d797689-2e01-4728-a269-95a59fcdd6d8', '6b1bf471-5c95-4b1a-9053-a8a770ed5afe', '55692a15-1e2e-4c74-89a0-4868420c1d24', '4d1544fe-3466-462a-9668-fd2d72e23610'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:19 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:19 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:19 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_27j5k1z5" returned: 1 in 0.560s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_27j5k1z5' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1513623a-8c75-43d2-a088-b861cd06b4da]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:19 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD Feb 24 11:04:19 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:19 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.515s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Deleted volume successfully. Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccd02594-2787-493f-8eb8-5f646817b70b tempest-SnapshotsActionsTest-1422410947 None] Lock "cinder-40141d40-0ca2-4ce7-96cc-86807ffce8d3-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:19 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] 4158f967-877e-452e-b5d3-debeeb743c37 was qcow2, converting to raw {{(pid=82627) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 24 11:04:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:19 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 Feb 24 11:04:19 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:20 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776" returned: 0 in 1.167s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:20 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_jwjgo93edevstack@QuobyteHD, size 112.00 MB, duration 1.17 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:04:20 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Converted 112.00 MB image at 95.88 MB/s Feb 24 11:04:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:20 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 1G Feb 24 11:04:20 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Flow 'volume_create_manager' (eadb96a4-fcae-4de8-b933-9c105a7de45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3757e032-93ef-4368-a458-c7aeca412527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3757e032-93ef-4368-a458-c7aeca412527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2124486120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9207651-6b6c-4c68-a05f-4c13e88e9f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58965d3564540c48c597a3d0806166e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:21Z,use_quota=True,user_id='9c0e25ff8a0440a98de3e3c1ef9ab802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ef3437-089d-43ac-a6b5-228cb6ac4ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ef3437-089d-43ac-a6b5-228cb6ac4ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060b49a2-3697-4e5f-98c9-3ffe3c8a2ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060b49a2-3697-4e5f-98c9-3ffe3c8a2ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9207651-6b6c-4c68-a05f-4c13e88e9f23', 'volume_name': 'volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefc3494-f1a4-4735-9f3d-0a48d4db446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefc3494-f1a4-4735-9f3d-0a48d4db446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c70be6-f26d-4688-b268-7511575eb204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:21 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Volume a9207651-6b6c-4c68-a05f-4c13e88e9f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23', 'volume_size': 1} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2124486120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9207651-6b6c-4c68-a05f-4c13e88e9f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58965d3564540c48c597a3d0806166e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:21Z,use_quota=True,user_id='9c0e25ff8a0440a98de3e3c1ef9ab802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Creating volume a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:21 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:21 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 1073741824 Feb 24 11:04:21 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:21 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 1G" returned: 0 in 0.553s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[47964a4c-f2a8-4b32-aac9-169dbad35b6e]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:21 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 Feb 24 11:04:21 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:21 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 1073741824" returned: 0 in 0.681s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:21 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 Feb 24 11:04:21 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:22 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776" returned: 0 in 0.567s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:22 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 Feb 24 11:04:22 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:22 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23" returned: 0 in 0.556s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c70be6-f26d-4688-b268-7511575eb204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96df3f98-3256-48e9-aba4-a4fd3b367e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:22 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Volume volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 (a9207651-6b6c-4c68-a05f-4c13e88e9f23): created successfully Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96df3f98-3256-48e9-aba4-a4fd3b367e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Flow 'volume_create_manager' (eadb96a4-fcae-4de8-b933-9c105a7de45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:22 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0ba5dc64-16f7-48db-868d-f8aceda60bd4 tempest-VolumesSnapshotListTestJSON-1933364788 None] Created volume successfully. Feb 24 11:04:22 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776" returned: 1 in 0.589s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Downloaded image 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume 091d4c47-0402-4254-84d8-2995d36be776 successfully. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 for user 1aa65179698c460eaa961b1b1b37f88b is deleted. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Marking volume 091d4c47-0402-4254-84d8-2995d36be776 as bootable. {{(pid=82627) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Copying metadata from image 4158f967-877e-452e-b5d3-debeeb743c37 to 091d4c47-0402-4254-84d8-2995d36be776. {{(pid=82627) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Creating volume glance metadata for volume 091d4c47-0402-4254-84d8-2995d36be776 backed by image 4158f967-877e-452e-b5d3-debeeb743c37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82627) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce6a3a4-df6f-47d0-a120-922b1bf87ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091d4c47-0402-4254-84d8-2995d36be776', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7672e56d-a0c0-468a-8ce4-b1d63d22c2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:22 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Volume volume-091d4c47-0402-4254-84d8-2995d36be776 (091d4c47-0402-4254-84d8-2995d36be776): created successfully Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7672e56d-a0c0-468a-8ce4-b1d63d22c2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (2cfb98b1-2f4a-4bf1-b28f-8ddbe4caabc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:22 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-53f67492-320f-47d9-82b4-e89e555e0878 tempest-VolumesGetTest-2116324429 None] Created volume successfully. Feb 24 11:04:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Creating offline snapshot bbfdf9ce-e3c7-484c-b587-7bfacabcc770 of volume a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:04:23 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a1bf54-399f-41ca-a327-329c6dec40e6]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:23 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 Feb 24 11:04:23 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:23 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23" returned: 0 in 0.640s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:24 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 1G Feb 24 11:04:24 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (534a5a41-a2e7-4736-8167-cf011849981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbdfd27-3e97-4157-b858-743c713e8de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbdfd27-3e97-4157-b858-743c713e8de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1335994897',display_name='tempest-VolumesGetTest-Volume-838961051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c385c4-4f6e-42bd-9ac1-0abf23c189fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:24Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870a63f5-43d7-452b-850f-8b0719be7054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870a63f5-43d7-452b-850f-8b0719be7054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fba5259-505d-4d29-a5a7-be08a64116c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fba5259-505d-4d29-a5a7-be08a64116c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27c385c4-4f6e-42bd-9ac1-0abf23c189fe', 'volume_name': 'volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23a5eb0-a6b5-4294-a96f-6b33105ff31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23a5eb0-a6b5-4294-a96f-6b33105ff31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f42fe85-77c1-4f12-9475-36257b75a73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:24 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Volume 27c385c4-4f6e-42bd-9ac1-0abf23c189fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe', 'volume_size': 1} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:24 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 1G" returned: 0 in 0.601s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:24 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 Feb 24 11:04:24 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:25 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:25 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 is being set with open permissions: ugo+rw Feb 24 11:04:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:25 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 Feb 24 11:04:25 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:25 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770" returned: 0 in 0.576s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:25 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.info Feb 24 11:04:25 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:26 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.info" returned: 0 in 0.459s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:26 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.info is being set with open permissions: ugo+rw Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:26 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.info Feb 24 11:04:26 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:26 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.info" returned: 0 in 0.466s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.285s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1335994897',display_name='tempest-VolumesGetTest-Volume-838961051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c385c4-4f6e-42bd-9ac1-0abf23c189fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1b07aac6024e7a9b478add18a25f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:24Z,use_quota=True,user_id='1aa65179698c460eaa961b1b1b37f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Creating volume 27c385c4-4f6e-42bd-9ac1-0abf23c189fe {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:26 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:26 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe 1073741824 Feb 24 11:04:26 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:26 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a49b88bf-75b8-4330-9e46-175b6917fb67 tempest-VolumesSnapshotListTestJSON-1933364788 None] Create snapshot completed successfully Feb 24 11:04:27 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe 1073741824" returned: 0 in 0.653s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:27 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe Feb 24 11:04:27 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7fb85fb1-da1d-42aa-a0cb-9c50eebedc6b tempest-GroupSnapshotsV319Test-578647185 None] Group tempest-GroupSnapshotsV319Test-Group-269983068: creating Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7fb85fb1-da1d-42aa-a0cb-9c50eebedc6b tempest-GroupSnapshotsV319Test-578647185 None] Group tempest-GroupSnapshotsV319Test-Group-269983068: created successfully Feb 24 11:04:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7fb85fb1-da1d-42aa-a0cb-9c50eebedc6b tempest-GroupSnapshotsV319Test-578647185 None] Create group completed successfully. Feb 24 11:04:27 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe" returned: 0 in 0.500s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.187s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Creating offline snapshot b6b5df3b-9811-47f4-9190-eb3292e0c3f2 of volume a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f42fe85-77c1-4f12-9475-36257b75a73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f78c335-0af1-4e45-ab0d-608ac44fdde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e74caf-8089-4f76-b502-d1cc6853411a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:27 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Volume volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe (27c385c4-4f6e-42bd-9ac1-0abf23c189fe): created successfully Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f78c335-0af1-4e45-ab0d-608ac44fdde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Flow 'volume_create_manager' (534a5a41-a2e7-4736-8167-cf011849981d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-82e1e301-aaac-4946-8bd7-323722f39d77 tempest-VolumesGetTest-2116324429 None] Created volume successfully. Feb 24 11:04:27 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 Feb 24 11:04:27 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:28 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770" returned: 0 in 0.545s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:28 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 1G Feb 24 11:04:28 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-27c385c4-4f6e-42bd-9ac1-0abf23c189fe-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Lock "cinder-27c385c4-4f6e-42bd-9ac1-0abf23c189fe-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-27c385c4-4f6e-42bd-9ac1-0abf23c189fe" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-27c385c4-4f6e-42bd-9ac1-0abf23c189fe" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f16029f-b0c9-4281-8a46-098e5f59bd26]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:28 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe Feb 24 11:04:28 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Flow 'volume_create_manager' (e1d5eafa-43b8-4ec6-9edf-ada9a16a0553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f870060-2ac0-4fe9-9086-4e4366f18c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f870060-2ac0-4fe9-9086-4e4366f18c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067973598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eebd7d1a-eea6-4a3a-9c08-a24e80bc667f,host='devstack@QuobyteHD#QuobyteHD',id=75d0faa4-46ee-4173-8fee-ed08d8b70a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f947629da8b847aaa8b6fd8b6136c961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:29Z,use_quota=True,user_id='e9d9651d297e4c2499c1e84c2008a068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178f5065-335e-4e8e-a9e5-cc617f90115c),volume_type_id=178f5065-335e-4e8e-a9e5-cc617f90115c)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519900ca-1989-486f-992f-f0406b84d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519900ca-1989-486f-992f-f0406b84d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b8b3fc-3cb4-4234-aed9-9fe256d83804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b8b3fc-3cb4-4234-aed9-9fe256d83804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d0faa4-46ee-4173-8fee-ed08d8b70a47', 'volume_name': 'volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fbbacd-8d48-4c25-9511-e9b1d0163e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fbbacd-8d48-4c25-9511-e9b1d0163e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b776816d-81c4-4ddc-8e3a-afa8b2c6be2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:29 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Volume 75d0faa4-46ee-4173-8fee-ed08d8b70a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47', 'volume_size': 1} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:29 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 1G" returned: 0 in 0.756s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:29 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 Feb 24 11:04:29 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:29 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe" returned: 0 in 0.659s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:29 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe Feb 24 11:04:29 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:29 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2" returned: 0 in 0.517s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:29 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 is being set with open permissions: ugo+rw Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:29 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 Feb 24 11:04:29 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:29 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-27c385c4-4f6e-42bd-9ac1-0abf23c189fe" returned: 0 in 0.459s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-27c385c4-4f6e-42bd-9ac1-0abf23c189fe" released by "delete_volume" :: held 1.144s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Created reservations ['348bce9f-c1aa-49e3-a4f5-a81d00f575c4', '751ee971-d57a-45e1-8af0-b3cdebd7c9ba', '2a0c27bb-9703-4b04-91d3-5de5964f8be3', 'bbe0532b-53c4-4db1-8534-63c059475656'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:29 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:29 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:30 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2" returned: 0 in 0.457s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eebd7d1a-eea6-4a3a-9c08-a24e80bc667f,created_at=2026-02-24T10:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067973598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eebd7d1a-eea6-4a3a-9c08-a24e80bc667f,host='devstack@QuobyteHD#QuobyteHD',id=75d0faa4-46ee-4173-8fee-ed08d8b70a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f947629da8b847aaa8b6fd8b6136c961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:29Z,use_quota=True,user_id='e9d9651d297e4c2499c1e84c2008a068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178f5065-335e-4e8e-a9e5-cc617f90115c),volume_type_id=178f5065-335e-4e8e-a9e5-cc617f90115c)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Creating volume 75d0faa4-46ee-4173-8fee-ed08d8b70a47 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:30 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:30 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-74accced-e4bf-4a76-bdb9-c88697804ece tempest-VolumesSnapshotListTestJSON-1933364788 None] Create snapshot completed successfully Feb 24 11:04:30 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 1073741824 Feb 24 11:04:30 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:30 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.472s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:30 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Deleted volume successfully. Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8f1d3991-fdf4-4a8a-b6c7-077bf9d6c206 tempest-VolumesGetTest-2116324429 None] Lock "cinder-27c385c4-4f6e-42bd-9ac1-0abf23c189fe-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:30 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 1073741824" returned: 0 in 0.579s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-091d4c47-0402-4254-84d8-2995d36be776-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:30 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Lock "cinder-091d4c47-0402-4254-84d8-2995d36be776-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:30 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Acquiring lock "cinder-quobyte-091d4c47-0402-4254-84d8-2995d36be776" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-091d4c47-0402-4254-84d8-2995d36be776" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1975db4e-ff7d-4453-90bc-cb584bb9d39b]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:30 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 Feb 24 11:04:30 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:31 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47" returned: 0 in 0.502s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.396s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b776816d-81c4-4ddc-8e3a-afa8b2c6be2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc27019-5a57-44bd-8ee4-19e5186e86a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Creating offline snapshot f628e74a-ebd9-42f0-881d-d51fcd71177d of volume a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:04:31 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Volume volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 (75d0faa4-46ee-4173-8fee-ed08d8b70a47): created successfully Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc27019-5a57-44bd-8ee4-19e5186e86a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Flow 'volume_create_manager' (e1d5eafa-43b8-4ec6-9edf-ada9a16a0553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94d8892-438f-4254-82a1-50acfbac45f0]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:31 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b3245502-6b67-45f3-b1db-73156a291f95 tempest-GroupSnapshotsV319Test-578647185 None] Created volume successfully. Feb 24 11:04:31 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776" returned: 0 in 0.527s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:31 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 Feb 24 11:04:31 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:31 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 Feb 24 11:04:31 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:31 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2" returned: 0 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:31 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d 1G Feb 24 11:04:31 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:31 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776" returned: 1 in 0.553s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:04:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:31 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776 Feb 24 11:04:31 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:32 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d 1G" returned: 0 in 0.607s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:32 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] GroupSnapshot dbefedd8-f64f-4f72-b0d0-b5c67a31de06: creating. Feb 24 11:04:32 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d Feb 24 11:04:32 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Group snapshot dbefedd8-f64f-4f72-b0d0-b5c67a31de06: creating. {{(pid=82627) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:32 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-091d4c47-0402-4254-84d8-2995d36be776" returned: 0 in 0.580s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Lock "cinder-quobyte-091d4c47-0402-4254-84d8-2995d36be776" released by "delete_volume" :: held 1.717s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Created reservations ['85c26c1d-540c-45cb-8035-68f7dba69d4d', '1e456814-c114-4d16-b65c-4e3ab126b9ef', 'efcef147-f927-46fe-8747-fa44b7ef1a00', '0211af3f-bb24-4881-92d4-551022304f35'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:32 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:32 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:33 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d" returned: 0 in 0.534s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:33 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d is being set with open permissions: ugo+rw Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:33 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d Feb 24 11:04:33 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:33 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.494s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Deleted volume successfully. Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4311663f-8fc4-42f5-843a-ddd06e5c2f2b tempest-VolumesGetTest-2116324429 None] Lock "cinder-091d4c47-0402-4254-84d8-2995d36be776-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:33 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d" returned: 0 in 0.442s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.935s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Creating offline snapshot 65d38985-6793-45cf-ac40-cc8eefa4b5f5 of volume 75d0faa4-46ee-4173-8fee-ed08d8b70a47 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:04:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-577bddb1-3bb3-4f85-98b0-19b5ba94fcb2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Create snapshot completed successfully Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b23a842-ff78-4eb9-abce-21f28bf1c0bb]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:33 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 Feb 24 11:04:33 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:34 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:34 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:34 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47" returned: 0 in 0.673s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:34 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 1G Feb 24 11:04:34 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:34 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.649s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-f628e74a-ebd9-42f0-881d-d51fcd71177d-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-f628e74a-ebd9-42f0-881d-d51fcd71177d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-quobyte-f628e74a-ebd9-42f0-881d-d51fcd71177d" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-f628e74a-ebd9-42f0-881d-d51fcd71177d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Deleting offline snapshot f628e74a-ebd9-42f0-881d-d51fcd71177d of volume a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:04:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] snapshot_file for this snap is: volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2acc8d-874a-42d7-8c16-ed749bce6248]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:35 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 1G" returned: 0 in 0.831s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:35 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 Feb 24 11:04:35 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:35 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d Feb 24 11:04:35 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:35 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d" returned: 0 in 0.544s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e3b38-d9a9-43a4-8142-c56f0a973ac8]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:35 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5" returned: 0 in 0.595s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:35 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:04:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:35 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 Feb 24 11:04:35 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:35 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 Feb 24 11:04:35 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:36 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2" returned: 0 in 0.638s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:36 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5" returned: 0 in 0.588s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:36 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d Feb 24 11:04:36 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:36 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.info Feb 24 11:04:36 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:36 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.info" returned: 0 in 0.577s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:36 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.info is being set with open permissions: ugo+rw: NotImplementedError Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:36 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.info Feb 24 11:04:36 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:36 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d" returned: 0 in 0.684s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:36 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d Feb 24 11:04:36 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Flow 'volume_create_manager' (65bf5394-804e-4067-ac78-5853ef18936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c19768-fb9c-4ea9-ac68-15b204fc29da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c19768-fb9c-4ea9-ac68-15b204fc29da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-512884110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efe14de-7130-4135-87d9-3b7fe48bb62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7b2ced885342c1922d6087af16c594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:37Z,use_quota=True,user_id='e1c555f9168c4e28ab332b337e5a89d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade823b3-335f-4bae-a01e-3d50ac5487f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade823b3-335f-4bae-a01e-3d50ac5487f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb979c9-02c8-4376-ad99-dd7a2269581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb979c9-02c8-4376-ad99-dd7a2269581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6efe14de-7130-4135-87d9-3b7fe48bb62b', 'volume_name': 'volume-6efe14de-7130-4135-87d9-3b7fe48bb62b', 'volume_size': 2}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8be182-2b53-4bbc-aeed-c273f05d3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8be182-2b53-4bbc-aeed-c273f05d3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:37 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a99002-b264-4f14-a0e9-317a31ddadc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:37 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Volume 6efe14de-7130-4135-87d9-3b7fe48bb62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6efe14de-7130-4135-87d9-3b7fe48bb62b', 'volume_size': 2} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.info" returned: 0 in 0.477s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.833s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-512884110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efe14de-7130-4135-87d9-3b7fe48bb62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7b2ced885342c1922d6087af16c594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:37Z,use_quota=True,user_id='e1c555f9168c4e28ab332b337e5a89d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Creating volume 6efe14de-7130-4135-87d9-3b7fe48bb62b {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:37 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b 2147483648 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:37 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b 2147483648 Feb 24 11:04:37 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:37 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a8609b72-b0cb-4170-a616-5e951bf693af tempest-GroupSnapshotsV319Test-578647185 None] group_snapshot dbefedd8-f64f-4f72-b0d0-b5c67a31de06: created successfully Feb 24 11:04:37 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.f628e74a-ebd9-42f0-881d-d51fcd71177d" returned: 0 in 0.508s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-f628e74a-ebd9-42f0-881d-d51fcd71177d" released by "_delete_snapshot" :: held 2.447s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" released by "delete_snapshot" :: held 2.463s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Created reservations ['a5a3bf56-d0bc-44d3-88fe-db54219e4b98', 'bb3c2588-a083-4db9-972a-bdbd5bf251ab', '5e9be42a-c07b-4821-93af-7d74cefffeae', '4f1e9e28-e224-4de8-a78f-381c991d8422'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:37 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Delete snapshot completed successfully. Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-30f3976b-d440-4445-a39d-f43216fd26d2 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-f628e74a-ebd9-42f0-881d-d51fcd71177d-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:37 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b 2147483648" returned: 0 in 0.598s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:37 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b Feb 24 11:04:37 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:38 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] group_snapshot dbefedd8-f64f-4f72-b0d0-b5c67a31de06: deleting Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] group_snapshot dbefedd8-f64f-4f72-b0d0-b5c67a31de06: deleting {{(pid=82627) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Acquiring lock "cinder-quobyte-75d0faa4-46ee-4173-8fee-ed08d8b70a47" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Lock "cinder-quobyte-75d0faa4-46ee-4173-8fee-ed08d8b70a47" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Acquiring lock "cinder-quobyte-65d38985-6793-45cf-ac40-cc8eefa4b5f5" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Lock "cinder-quobyte-65d38985-6793-45cf-ac40-cc8eefa4b5f5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Deleting offline snapshot 65d38985-6793-45cf-ac40-cc8eefa4b5f5 of volume 75d0faa4-46ee-4173-8fee-ed08d8b70a47 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] snapshot_file for this snap is: volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-b6b5df3b-9811-47f4-9190-eb3292e0c3f2-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bedf7b-31a1-426b-8ef6-ab163e8004d9]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-b6b5df3b-9811-47f4-9190-eb3292e0c3f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-quobyte-b6b5df3b-9811-47f4-9190-eb3292e0c3f2" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-b6b5df3b-9811-47f4-9190-eb3292e0c3f2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Deleting offline snapshot b6b5df3b-9811-47f4-9190-eb3292e0c3f2 of volume a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] snapshot_file for this snap is: volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a575e5a-2215-45a1-8f09-f24cf21696c7]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:38 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 Feb 24 11:04:38 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:38 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 Feb 24 11:04:38 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:38 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b" returned: 0 in 0.535s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a99002-b264-4f14-a0e9-317a31ddadc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6efe14de-7130-4135-87d9-3b7fe48bb62b', 'volume_size': 2}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437cd3f4-ad84-42bf-991c-5cc0bbe99478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:38 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Volume volume-6efe14de-7130-4135-87d9-3b7fe48bb62b (6efe14de-7130-4135-87d9-3b7fe48bb62b): created successfully Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437cd3f4-ad84-42bf-991c-5cc0bbe99478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Flow 'volume_create_manager' (65bf5394-804e-4067-ac78-5853ef18936d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:38 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6bda231b-1446-460e-a8c7-bdee54a972af tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Created volume successfully. Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Flow 'volume_create_manager' (bd2fcd30-0881-4fc0-8b50-1f1735fe456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41b833f-1ef4-4232-9607-d78763c93ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41b833f-1ef4-4232-9607-d78763c93ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1697936319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7aee6c-f74d-4f29-b9c9-37fcd0985226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07fb36d6cc424b2e908e33f9106fb897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:39Z,use_quota=True,user_id='793aeaf0714e4eaaa1b853cb3982f5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8feb10ee-e9b2-4e17-826a-71ed255bfc74),volume_type_id=8feb10ee-e9b2-4e17-826a-71ed255bfc74)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9352e1d7-68b1-4ebf-b28f-bc25d7bbe5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9352e1d7-68b1-4ebf-b28f-bc25d7bbe5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdce4b76-95b4-4d4a-8dee-23d11844642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdce4b76-95b4-4d4a-8dee-23d11844642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7aee6c-f74d-4f29-b9c9-37fcd0985226', 'volume_name': 'volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:38 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe98db8-cb81-4f1c-b356-a536e5b687a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe98db8-cb81-4f1c-b356-a536e5b687a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1a6b28-4a50-4860-9a65-97bfc1eb7d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:38 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Volume bd7aee6c-f74d-4f29-b9c9-37fcd0985226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226', 'volume_size': 1} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1697936319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7aee6c-f74d-4f29-b9c9-37fcd0985226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07fb36d6cc424b2e908e33f9106fb897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:39Z,use_quota=True,user_id='793aeaf0714e4eaaa1b853cb3982f5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8feb10ee-e9b2-4e17-826a-71ed255bfc74),volume_type_id=8feb10ee-e9b2-4e17-826a-71ed255bfc74)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Creating volume bd7aee6c-f74d-4f29-b9c9-37fcd0985226 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:38 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5" returned: 0 in 0.613s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[130d4182-1052-4e54-a601-d746064c1233]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:38 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 1073741824 Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:38 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:38 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2" returned: 0 in 0.582s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ecf6a-f4b6-44c4-85be-fe3704b00535]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:38 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 Feb 24 11:04:38 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:38 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 Feb 24 11:04:38 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:39 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 1073741824" returned: 0 in 0.500s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:39 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 Feb 24 11:04:39 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:39 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47" returned: 0 in 0.520s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:39 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 Feb 24 11:04:39 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:39 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770" returned: 0 in 0.511s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:39 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 Feb 24 11:04:39 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:39 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226" returned: 0 in 0.446s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.180s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1a6b28-4a50-4860-9a65-97bfc1eb7d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ee8918-9da2-45bc-ba35-34e086541fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Creating offline snapshot 999a815f-0e1d-4203-8c17-e617f6c6a74d of volume 6efe14de-7130-4135-87d9-3b7fe48bb62b {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:04:39 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Volume volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 (bd7aee6c-f74d-4f29-b9c9-37fcd0985226): created successfully Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ee8918-9da2-45bc-ba35-34e086541fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Flow 'volume_create_manager' (bd2fcd30-0881-4fc0-8b50-1f1735fe456a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4142c081-d1be-47c8-8ed9-f10818ca329f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:39 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-fd71dafa-34db-41bb-a1db-8efb06fa924f tempest-VolumeTypesAccessTest-571223690 None] Created volume successfully. Feb 24 11:04:39 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5" returned: 0 in 0.535s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:39 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2" returned: 0 in 0.499s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:39 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b Feb 24 11:04:39 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:39 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5 Feb 24 11:04:39 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:39 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2 Feb 24 11:04:39 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:40 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47.65d38985-6793-45cf-ac40-cc8eefa4b5f5" returned: 0 in 0.418s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Lock "cinder-quobyte-65d38985-6793-45cf-ac40-cc8eefa4b5f5" released by "_delete_snapshot" :: held 2.150s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Lock "cinder-quobyte-75d0faa4-46ee-4173-8fee-ed08d8b70a47" released by "delete_snapshot" :: held 2.169s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:40 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.b6b5df3b-9811-47f4-9190-eb3292e0c3f2" returned: 0 in 0.432s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:40 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b" returned: 0 in 0.521s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d 2G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-b6b5df3b-9811-47f4-9190-eb3292e0c3f2" released by "_delete_snapshot" :: held 2.094s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" released by "delete_snapshot" :: held 2.116s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:40 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d 2G Feb 24 11:04:40 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Created reservations ['90429c9e-3307-4ebd-aef9-633ee6c8b348', 'cc43787f-4360-49c6-a0b2-837804654563', 'e75478f5-d67c-447d-801c-07cdb3afcd2f', '56474a45-f353-4869-94e7-51f8b5b5d97a'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:40 devstack cinder-volume[82627]: WARNING cinder.quota [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-580230295 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-580230295, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:04:40 devstack cinder-volume[82627]: WARNING cinder.quota [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-580230295 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-580230295, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:04:40 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Delete snapshot completed successfully. Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0da40408-0f3d-41e7-971f-c313706e514f tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-b6b5df3b-9811-47f4-9190-eb3292e0c3f2-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] Created reservations ['2b71981d-906e-4a7a-a893-cb5458f0db5e', '549a3bde-5b0f-4734-aa4c-8249fdef365b', 'ba0b1e06-6ded-440f-b321-3c098cc5fec4', 'c33cbce3-7a8b-4731-8dca-3069a25be691'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:40 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-334f89ce-d29a-4688-ab53-91a6768a1de4 tempest-GroupSnapshotsV319Test-578647185 None] group_snapshot dbefedd8-f64f-4f72-b0d0-b5c67a31de06: deleted successfully Feb 24 11:04:40 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d 2G" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6efe14de-7130-4135-87d9-3b7fe48bb62b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:40 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6efe14de-7130-4135-87d9-3b7fe48bb62b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d Feb 24 11:04:40 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Acquiring lock "cinder-bd7aee6c-f74d-4f29-b9c9-37fcd0985226-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Lock "cinder-bd7aee6c-f74d-4f29-b9c9-37fcd0985226-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Acquiring lock "cinder-quobyte-bd7aee6c-f74d-4f29-b9c9-37fcd0985226" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Lock "cinder-quobyte-bd7aee6c-f74d-4f29-b9c9-37fcd0985226" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90a7c5-a78b-4f2e-9ccb-bbf5fa2638cf]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:41 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 Feb 24 11:04:41 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:41 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6efe14de-7130-4135-87d9-3b7fe48bb62b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d" returned: 0 in 0.444s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:41 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d is being set with open permissions: ugo+rw Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:41 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d Feb 24 11:04:41 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-bbfdf9ce-e3c7-484c-b587-7bfacabcc770-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-bbfdf9ce-e3c7-484c-b587-7bfacabcc770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-quobyte-bbfdf9ce-e3c7-484c-b587-7bfacabcc770" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-bbfdf9ce-e3c7-484c-b587-7bfacabcc770" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Deleting offline snapshot bbfdf9ce-e3c7-484c-b587-7bfacabcc770 of volume a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] snapshot_file for this snap is: volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5634757-036c-4a05-9bcb-b6bdaed87f95]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:41 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 Feb 24 11:04:41 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Acquiring lock "cinder-quobyte-75d0faa4-46ee-4173-8fee-ed08d8b70a47" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Lock "cinder-quobyte-75d0faa4-46ee-4173-8fee-ed08d8b70a47" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a853ab-2d66-4279-bfb3-c24174f7a438]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:41 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226" returned: 0 in 0.631s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:41 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226 Feb 24 11:04:41 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:41 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 Feb 24 11:04:41 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:41 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d" returned: 0 in 0.445s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:41 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.info Feb 24 11:04:41 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:41 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770" returned: 0 in 0.579s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d952f2c6-124b-427e-81f1-d7a6b3300c6d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:42 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 Feb 24 11:04:42 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:42 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-bd7aee6c-f74d-4f29-b9c9-37fcd0985226" returned: 0 in 0.455s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Lock "cinder-quobyte-bd7aee6c-f74d-4f29-b9c9-37fcd0985226" released by "delete_volume" :: held 1.114s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:42 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47" returned: 0 in 0.549s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:42 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47 Feb 24 11:04:42 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:42 devstack cinder-volume[82627]: WARNING cinder.quota [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-635446407 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-635446407, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:04:42 devstack cinder-volume[82627]: WARNING cinder.quota [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-635446407 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-635446407, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:04:42 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.info" returned: 0 in 0.432s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:42 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.info is being set with open permissions: ugo+rw Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Created reservations ['c51610f2-b2d3-4840-8506-d6b9bda3088a', '83510ac8-e57e-46c6-8e9a-2a8cc6dc5c1d', '90bea584-e298-418c-a898-5bced04701bd', '3520ac73-b9b3-4f43-94e3-cd25d1b2536d'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:42 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.info Feb 24 11:04:42 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:42 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:42 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:42 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23" returned: 0 in 0.528s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:42 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 Feb 24 11:04:42 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:42 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-75d0faa4-46ee-4173-8fee-ed08d8b70a47" returned: 0 in 0.437s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Lock "cinder-quobyte-75d0faa4-46ee-4173-8fee-ed08d8b70a47" released by "delete_volume" :: held 1.020s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Created reservations ['76f63cfd-a226-4c67-be48-2030c857a698'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:42 devstack cinder-volume[82627]: WARNING cinder.quota [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-580230295 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-580230295, it is now deprecated. Please use the default quota class for default quota. Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Created reservations ['994c4f68-798f-4bda-91c9-ab92d6f0c6f8', 'abc15ac5-9ea5-41f4-af51-6395827bc477', '3e787d85-1f15-4a32-9df8-38441cd7bcd0', 'f1dcd7e4-2e2d-4279-a64d-9fe99eeaa719'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:42 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.461s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:42 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.info" returned: 0 in 0.532s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:42 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Deleted volume successfully. Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.962s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:42 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:42 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:42 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4fcdf121-d4f4-4c07-8a65-4029d4fd22b9 tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Create snapshot completed successfully Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c7bf4c92-6044-4b2e-a1cd-ea238e0a76ff tempest-VolumeTypesAccessTest-571223690 None] Lock "cinder-bd7aee6c-f74d-4f29-b9c9-37fcd0985226-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:42 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770" returned: 0 in 0.491s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:42 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770 Feb 24 11:04:42 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:43 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.425s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:43 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-18274307-6ff0-452f-b26c-139db59729bf tempest-GroupSnapshotsV319Test-578647185 None] Delete group completed successfully. Feb 24 11:04:43 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23.bbfdf9ce-e3c7-484c-b587-7bfacabcc770" returned: 0 in 0.421s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-bbfdf9ce-e3c7-484c-b587-7bfacabcc770" released by "_delete_snapshot" :: held 2.074s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" released by "delete_snapshot" :: held 2.086s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Created reservations ['ff6c8ddc-2ce8-472a-b33c-6ac86e0154d7', '92fa07db-8188-4165-9a82-d4f8fd1d6783', '64364e6b-9b1d-4f95-9c7f-c557c3e0c8a9', '8e0ad311-f8cc-4b6f-813c-5b01b3dc5134'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:43 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Delete snapshot completed successfully. Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c453c8d1-47ea-4147-90ca-03e715a80df3 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-bbfdf9ce-e3c7-484c-b587-7bfacabcc770-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "cinder-999a815f-0e1d-4203-8c17-e617f6c6a74d-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-999a815f-0e1d-4203-8c17-e617f6c6a74d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "cinder-quobyte-6efe14de-7130-4135-87d9-3b7fe48bb62b" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-quobyte-6efe14de-7130-4135-87d9-3b7fe48bb62b" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "cinder-quobyte-999a815f-0e1d-4203-8c17-e617f6c6a74d" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-quobyte-999a815f-0e1d-4203-8c17-e617f6c6a74d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Deleting offline snapshot 999a815f-0e1d-4203-8c17-e617f6c6a74d of volume 6efe14de-7130-4135-87d9-3b7fe48bb62b {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] snapshot_file for this snap is: volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62c866b-3476-4a4f-af27-eed40e082498]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:43 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d Feb 24 11:04:43 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:44 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d" returned: 0 in 0.590s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6efe14de-7130-4135-87d9-3b7fe48bb62b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb490bb6-8c9d-433c-8648-67fddaa5a241]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-a9207651-6b6c-4c68-a05f-4c13e88e9f23-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-a9207651-6b6c-4c68-a05f-4c13e88e9f23-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:44 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b Feb 24 11:04:44 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9833f9-2595-497a-b2a5-dc640a545bb9]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:44 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 Feb 24 11:04:44 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:45 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b" returned: 0 in 0.621s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:45 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d Feb 24 11:04:45 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:45 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23" returned: 0 in 0.717s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:45 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23 Feb 24 11:04:45 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:45 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d" returned: 0 in 0.578s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:45 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d Feb 24 11:04:45 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:45 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a9207651-6b6c-4c68-a05f-4c13e88e9f23" returned: 0 in 0.601s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-quobyte-a9207651-6b6c-4c68-a05f-4c13e88e9f23" released by "delete_volume" :: held 1.355s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Created reservations ['3a49c225-1ead-45cf-8b9e-b6286569fcd1', '30e078d6-7805-4b13-b577-39ce6b96e4b2', '9bb61676-d31f-41d9-a6d4-313845898d35', '4f84038a-5fe5-4145-8341-098c081d734a'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:46 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:46 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:46 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b.999a815f-0e1d-4203-8c17-e617f6c6a74d" returned: 0 in 0.506s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-quobyte-999a815f-0e1d-4203-8c17-e617f6c6a74d" released by "_delete_snapshot" :: held 2.389s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-quobyte-6efe14de-7130-4135-87d9-3b7fe48bb62b" released by "delete_snapshot" :: held 2.402s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Created reservations ['1e960d73-d102-4fbf-8632-9b7e97b9434f', '8cdd7761-b1cb-4fa8-afee-3bd0b504b558', 'b82536b0-ad8c-449f-a8f9-768347a03e18', 'f320d86c-c3c4-4a87-9043-9c063400b78d'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:46 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Delete snapshot completed successfully. Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6544554f-560d-414e-93c0-0e3bf60a280c tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-999a815f-0e1d-4203-8c17-e617f6c6a74d-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:46 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.502s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:46 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Deleted volume successfully. Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe82f7b5-2e39-4986-bb47-df1546262403 tempest-VolumesSnapshotListTestJSON-1933364788 None] Lock "cinder-a9207651-6b6c-4c68-a05f-4c13e88e9f23-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "cinder-6efe14de-7130-4135-87d9-3b7fe48bb62b-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-6efe14de-7130-4135-87d9-3b7fe48bb62b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "cinder-quobyte-6efe14de-7130-4135-87d9-3b7fe48bb62b" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-quobyte-6efe14de-7130-4135-87d9-3b7fe48bb62b" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:47 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b042fadc-e6db-4eb4-90ed-a400c0067232]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:47 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b Feb 24 11:04:47 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:47 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b" returned: 0 in 0.674s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:47 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b Feb 24 11:04:47 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:48 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6efe14de-7130-4135-87d9-3b7fe48bb62b" returned: 0 in 0.515s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-quobyte-6efe14de-7130-4135-87d9-3b7fe48bb62b" released by "delete_volume" :: held 1.221s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Created reservations ['d0110134-0729-491e-8022-f035b9a5d5c5', '83adb932-8642-4fb9-a43c-0e0a32ed7254', 'd9234930-c8a4-4267-a080-85ab399b5d34', '59f28ea3-d514-4821-8ee5-00c9a6d3c5cb'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:48 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:48 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:48 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.509s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:48 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Deleted volume successfully. Feb 24 11:04:48 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ce8dcd73-7728-493d-8204-ec2a10da6eaf tempest-VolumesSnapshotNegativeTestJSON-354289429 None] Lock "cinder-6efe14de-7130-4135-87d9-3b7fe48bb62b-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (3ee732ab-b771-4f0f-9d39-bbb3d67a1ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8951222-0fbf-4559-b659-56d19aab5cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8951222-0fbf-4559-b659-56d19aab5cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-892177634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de18a25-6975-4cb7-b578-1dbb19f7f21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:49Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0701fb41-78d6-4733-93be-01c7411061c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0701fb41-78d6-4733-93be-01c7411061c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92d9480-eb9a-4934-b14e-1964087ac20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92d9480-eb9a-4934-b14e-1964087ac20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de18a25-6975-4cb7-b578-1dbb19f7f21c', 'volume_name': 'volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d1d267-1ae0-4139-99d9-3bed26fd863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d1d267-1ae0-4139-99d9-3bed26fd863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9a9eac-de1f-4ded-bb01-d442437edc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Volume 0de18a25-6975-4cb7-b578-1dbb19f7f21c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c', 'volume_size': 1} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-892177634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de18a25-6975-4cb7-b578-1dbb19f7f21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:49Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Creating volume 0de18a25-6975-4cb7-b578-1dbb19f7f21c {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:49 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:49 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c 1073741824 Feb 24 11:04:49 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (b10f2fce-2c3e-4601-a0bb-29da86d575d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053d3c71-52d6-4b56-8f1a-38629d3129f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053d3c71-52d6-4b56-8f1a-38629d3129f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177632312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c10ab3c-8a81-4c74-8d61-de6d2ed85755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:50Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6a4754-0dd9-48b0-a64a-91c054384871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6a4754-0dd9-48b0-a64a-91c054384871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fa8085-04f1-49b6-9ecc-f32437f6d9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fa8085-04f1-49b6-9ecc-f32437f6d9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c10ab3c-8a81-4c74-8d61-de6d2ed85755', 'volume_name': 'volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5cf7ce-bbfa-4362-9ec8-d1bce72dd937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5cf7ce-bbfa-4362-9ec8-d1bce72dd937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc197053-144d-46a7-aab4-a5c148a359ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Volume 5c10ab3c-8a81-4c74-8d61-de6d2ed85755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755', 'volume_size': 1} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (9a0a35fa-b74d-47c0-b11d-9b5542b33b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a9b495-7c04-4120-9ea6-45f05bf3c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a9b495-7c04-4120-9ea6-45f05bf3c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554914515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9407aba-b000-4db6-9286-382abd9ed5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:50Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2903e8-a3db-4176-8793-79e59093cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2903e8-a3db-4176-8793-79e59093cac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148c5e48-2114-43d1-921c-99054ecdf110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148c5e48-2114-43d1-921c-99054ecdf110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9407aba-b000-4db6-9286-382abd9ed5af', 'volume_name': 'volume-d9407aba-b000-4db6-9286-382abd9ed5af', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9350db17-8219-4c47-89e0-8f4c153b4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9350db17-8219-4c47-89e0-8f4c153b4739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46492ab-cf76-46fb-81cb-1e19a63bd89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Volume d9407aba-b000-4db6-9286-382abd9ed5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9407aba-b000-4db6-9286-382abd9ed5af', 'volume_size': 1} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:50 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (eddb8965-f879-4974-9cd3-feb7c9cac490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a48b138-d2a5-4a00-932c-313f8c229a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c 1073741824" returned: 0 in 0.814s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a48b138-d2a5-4a00-932c-313f8c229a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962797909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fad0be-6249-441e-920b-1cf8968d88b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:50Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91fc43d-84e0-4329-9db0-5b9408ea21d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91fc43d-84e0-4329-9db0-5b9408ea21d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a7cfe6-6f3e-488d-bcd0-9e3e92242ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a7cfe6-6f3e-488d-bcd0-9e3e92242ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fad0be-6249-441e-920b-1cf8968d88b7', 'volume_name': 'volume-c1fad0be-6249-441e-920b-1cf8968d88b7', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2df4f4-1317-437c-9abe-d4f48d2d95a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2df4f4-1317-437c-9abe-d4f48d2d95a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952a0567-fa5a-47bd-b263-6d37c477d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Volume c1fad0be-6249-441e-920b-1cf8968d88b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fad0be-6249-441e-920b-1cf8968d88b7', 'volume_size': 1} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:50 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c Feb 24 11:04:50 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (01af0636-1723-47bb-8f2e-c0d70cfa0109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e56397e-fd4a-4190-8308-85ceadfdc9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e56397e-fd4a-4190-8308-85ceadfdc9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828438160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ce217-104f-4302-bfb8-672d5a4a8fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:51Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987025e4-5859-4560-bbfd-110eccbd665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987025e4-5859-4560-bbfd-110eccbd665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f322a6e-8124-4a55-8ded-f23234636688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f322a6e-8124-4a55-8ded-f23234636688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438ce217-104f-4302-bfb8-672d5a4a8fe8', 'volume_name': 'volume-438ce217-104f-4302-bfb8-672d5a4a8fe8', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f061cc-e38a-4fe6-8fc7-1075e1656832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f061cc-e38a-4fe6-8fc7-1075e1656832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e1e37a-81d6-4842-8e81-8342c40da64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:50 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Volume 438ce217-104f-4302-bfb8-672d5a4a8fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438ce217-104f-4302-bfb8-672d5a4a8fe8', 'volume_size': 1} Feb 24 11:04:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:51 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c" returned: 0 in 0.681s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177632312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c10ab3c-8a81-4c74-8d61-de6d2ed85755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:50Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Creating volume 5c10ab3c-8a81-4c74-8d61-de6d2ed85755 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:51 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9a9eac-de1f-4ded-bb01-d442437edc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc910533-5097-43fe-a616-1748b06d4f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:51 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Volume volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c (0de18a25-6975-4cb7-b578-1dbb19f7f21c): created successfully Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc910533-5097-43fe-a616-1748b06d4f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:51 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 1073741824 Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (3ee732ab-b771-4f0f-9d39-bbb3d67a1ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:51 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:51 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-58269d96-76f1-47d5-ad2b-cfa4906d2b97 tempest-CreateVolumesFromImageTest-871152102 None] Created volume successfully. Feb 24 11:04:51 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 1073741824" returned: 0 in 0.719s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:51 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 Feb 24 11:04:51 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:52 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755" returned: 0 in 0.468s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.317s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554914515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9407aba-b000-4db6-9286-382abd9ed5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:50Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Creating volume d9407aba-b000-4db6-9286-382abd9ed5af {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:52 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:52 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af 1073741824 Feb 24 11:04:52 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc197053-144d-46a7-aab4-a5c148a359ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb31d435-45f9-4883-85bb-c6c2c6706073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:52 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Volume volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 (5c10ab3c-8a81-4c74-8d61-de6d2ed85755): created successfully Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb31d435-45f9-4883-85bb-c6c2c6706073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (b10f2fce-2c3e-4601-a0bb-29da86d575d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:52 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d2e995a0-af1a-48a5-983f-69d7fa2e079f tempest-CreateVolumesFromImageTest-871152102 None] Created volume successfully. Feb 24 11:04:52 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af 1073741824" returned: 0 in 0.626s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:53 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af Feb 24 11:04:53 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Flow 'volume_create_manager' (8b7bfecb-aa36-4cde-8fa7-3c31fd55e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d988e9fd-7fcf-4c76-a199-15501bd5a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d988e9fd-7fcf-4c76-a199-15501bd5a62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1624983299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a203d546-b186-4a7b-80d3-4cc9533fc719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb3bf5c3b934881a22fbd5c997a1294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:53Z,use_quota=True,user_id='09205adb9e9d4995b1e937ee7bcd5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5c66ff-1f60-4e96-83db-c486dcb168b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5c66ff-1f60-4e96-83db-c486dcb168b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a627f-868e-4a16-9494-a89961fbc942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a627f-868e-4a16-9494-a89961fbc942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a203d546-b186-4a7b-80d3-4cc9533fc719', 'volume_name': 'volume-a203d546-b186-4a7b-80d3-4cc9533fc719', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd4caf4-9db6-4983-a714-c019bf0df021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd4caf4-9db6-4983-a714-c019bf0df021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e95c2ec-1794-42f0-ac22-8d11ebd33010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:53 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Volume a203d546-b186-4a7b-80d3-4cc9533fc719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a203d546-b186-4a7b-80d3-4cc9533fc719', 'volume_size': 1} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:53 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af" returned: 0 in 0.522s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.125s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962797909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fad0be-6249-441e-920b-1cf8968d88b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:50Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Creating volume c1fad0be-6249-441e-920b-1cf8968d88b7 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:53 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46492ab-cf76-46fb-81cb-1e19a63bd89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9407aba-b000-4db6-9286-382abd9ed5af', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:53 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 1073741824 Feb 24 11:04:53 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c9b006-cd1a-4778-8f3b-eba11cb46e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:53 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Volume volume-d9407aba-b000-4db6-9286-382abd9ed5af (d9407aba-b000-4db6-9286-382abd9ed5af): created successfully Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c9b006-cd1a-4778-8f3b-eba11cb46e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (9a0a35fa-b74d-47c0-b11d-9b5542b33b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:53 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-bafb331d-5d59-44a6-8a0f-18330a59ec16 tempest-CreateVolumesFromImageTest-871152102 None] Created volume successfully. Feb 24 11:04:54 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 1073741824" returned: 0 in 0.549s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:54 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 Feb 24 11:04:54 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Flow 'volume_create_manager' (3d78ea26-b8ed-4474-a6d8-5de6d31a5bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a578789-c8cc-47e6-b132-e662ff908a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a578789-c8cc-47e6-b132-e662ff908a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1762594228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578275f05c5a466aaf80b52f59aba155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:54Z,use_quota=True,user_id='56e85fcea4174d1e98bbd8ff931c46cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a033586e-352c-4993-a53c-fce23da57296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a033586e-352c-4993-a53c-fce23da57296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217e20a9-6a0f-4ec4-bd9c-cc33dfddc0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217e20a9-6a0f-4ec4-bd9c-cc33dfddc0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8', 'volume_name': 'volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80f693b-2e7b-45e7-ad1a-c1dab4a42ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80f693b-2e7b-45e7-ad1a-c1dab4a42ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42bd82f-c8ba-45b9-928d-d118abd825f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:54 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Volume d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8', 'volume_size': 1} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:54 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7" returned: 0 in 0.426s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.831s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828438160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ce217-104f-4302-bfb8-672d5a4a8fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f0180500444c0a72cb4ecf2beee9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:51Z,use_quota=True,user_id='714eb29b64664e6eb64b5b48e456fb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Creating volume 438ce217-104f-4302-bfb8-672d5a4a8fe8 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:54 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:54 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 1073741824 Feb 24 11:04:54 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952a0567-fa5a-47bd-b263-6d37c477d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fad0be-6249-441e-920b-1cf8968d88b7', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2ebff2-d524-49f4-9bfe-fd6bd47b43e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:54 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Volume volume-c1fad0be-6249-441e-920b-1cf8968d88b7 (c1fad0be-6249-441e-920b-1cf8968d88b7): created successfully Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2ebff2-d524-49f4-9bfe-fd6bd47b43e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (eddb8965-f879-4974-9cd3-feb7c9cac490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ec8421a6-8d8a-46da-82aa-decf1b2bc116 tempest-CreateVolumesFromImageTest-871152102 None] Created volume successfully. Feb 24 11:04:55 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 1073741824" returned: 0 in 0.584s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:55 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 Feb 24 11:04:55 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:55 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8" returned: 0 in 0.442s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.140s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1624983299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a203d546-b186-4a7b-80d3-4cc9533fc719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb3bf5c3b934881a22fbd5c997a1294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:53Z,use_quota=True,user_id='09205adb9e9d4995b1e937ee7bcd5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Creating volume a203d546-b186-4a7b-80d3-4cc9533fc719 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:55 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e1e37a-81d6-4842-8e81-8342c40da64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438ce217-104f-4302-bfb8-672d5a4a8fe8', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:55 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 1073741824 Feb 24 11:04:55 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268a3285-362e-4369-b2b5-a1ebf989939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:55 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Volume volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 (438ce217-104f-4302-bfb8-672d5a4a8fe8): created successfully Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268a3285-362e-4369-b2b5-a1ebf989939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Flow 'volume_create_manager' (01af0636-1723-47bb-8f2e-c0d70cfa0109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:55 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-60935803-dfd5-4e7c-8c74-f5e50a76310a tempest-CreateVolumesFromImageTest-871152102 None] Created volume successfully. Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-438ce217-104f-4302-bfb8-672d5a4a8fe8-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-438ce217-104f-4302-bfb8-672d5a4a8fe8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-quobyte-438ce217-104f-4302-bfb8-672d5a4a8fe8" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-438ce217-104f-4302-bfb8-672d5a4a8fe8" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb5626-953c-4409-942f-e07ee9f1f5e9]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:56 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 1073741824" returned: 0 in 0.628s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:56 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 Feb 24 11:04:56 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:56 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 Feb 24 11:04:56 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:56 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719" returned: 0 in 0.517s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.517s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1762594228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578275f05c5a466aaf80b52f59aba155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:04:54Z,use_quota=True,user_id='56e85fcea4174d1e98bbd8ff931c46cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Creating volume d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:04:56 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:56 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e95c2ec-1794-42f0-ac22-8d11ebd33010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a203d546-b186-4a7b-80d3-4cc9533fc719', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9aeb2dd-1ad3-4e66-9f1c-2a986eb17569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:56 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 1073741824 Feb 24 11:04:56 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8" returned: 0 in 0.643s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:56 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Volume volume-a203d546-b186-4a7b-80d3-4cc9533fc719 (a203d546-b186-4a7b-80d3-4cc9533fc719): created successfully Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9aeb2dd-1ad3-4e66-9f1c-2a986eb17569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Flow 'volume_create_manager' (8b7bfecb-aa36-4cde-8fa7-3c31fd55e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4be6b356-8c2e-4ec6-8a6c-f9582a4f45f2 tempest-VolumesTransfersV355Test-918249420 None] Created volume successfully. Feb 24 11:04:56 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8 Feb 24 11:04:56 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:57 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 1073741824" returned: 0 in 0.565s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:57 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-438ce217-104f-4302-bfb8-672d5a4a8fe8" returned: 0 in 0.530s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-438ce217-104f-4302-bfb8-672d5a4a8fe8" released by "delete_volume" :: held 1.200s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Created reservations ['42de5e83-930b-4f63-a0dd-b10c8f01eacd', '1a64d0af-f9e6-4ab4-9fbe-f41c158e2039', '92f06fc2-8296-4a78-a05b-19840c2de4c4', '077ac38c-9a9f-4088-86a6-a81d162546a7'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:57 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 Feb 24 11:04:57 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:57 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:57 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:58 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8" returned: 0 in 0.578s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42bd82f-c8ba-45b9-928d-d118abd825f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:58 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033f5a3f-ff9b-4bbe-9a7b-ec5be9a95571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.568s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:04:58 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Volume volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 (d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8): created successfully Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033f5a3f-ff9b-4bbe-9a7b-ec5be9a95571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Flow 'volume_create_manager' (3d78ea26-b8ed-4474-a6d8-5de6d31a5bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:04:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9a41a9cc-f66d-436d-bfa6-44572602fa93 tempest-VolumesTransfersV355Test-1564788903 None] Transfer volume completed successfully. Feb 24 11:04:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Deleted volume successfully. Feb 24 11:04:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4ad9fcb9-a31f-4b1a-b82f-6803758a7f30 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Created volume successfully. Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b258a349-cc78-4fb9-b289-839a69a9488c tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-438ce217-104f-4302-bfb8-672d5a4a8fe8-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-c1fad0be-6249-441e-920b-1cf8968d88b7-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-c1fad0be-6249-441e-920b-1cf8968d88b7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-quobyte-c1fad0be-6249-441e-920b-1cf8968d88b7" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-c1fad0be-6249-441e-920b-1cf8968d88b7" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee134a-4a6e-41d3-88db-aeae18527ab5]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:58 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 Feb 24 11:04:58 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Acquiring lock "cinder-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "cinder-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Acquiring lock "cinder-quobyte-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "cinder-quobyte-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8" acquired by "delete_volume" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ee0b9-eb85-4b4d-8032-aa3d4d3bb1ed]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:58 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 Feb 24 11:04:58 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Acquiring lock "cinder-a203d546-b186-4a7b-80d3-4cc9533fc719-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Lock "cinder-a203d546-b186-4a7b-80d3-4cc9533fc719-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:59 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Acquiring lock "cinder-quobyte-a203d546-b186-4a7b-80d3-4cc9533fc719" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7" returned: 0 in 0.693s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Lock "cinder-quobyte-a203d546-b186-4a7b-80d3-4cc9533fc719" acquired by "delete_volume" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6fb89-03c3-41a1-915a-579613612e76]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:04:59 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7 Feb 24 11:04:59 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:59 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 Feb 24 11:04:59 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:59 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8" returned: 0 in 0.624s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:59 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8 Feb 24 11:04:59 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:59 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c1fad0be-6249-441e-920b-1cf8968d88b7" returned: 0 in 0.608s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-c1fad0be-6249-441e-920b-1cf8968d88b7" released by "delete_volume" :: held 1.327s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:59 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719" returned: 0 in 0.620s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Created reservations ['55e1ac68-3031-4fa1-872c-140bf1eb855c', 'cd8decbb-4874-4ed6-b83f-adb0b829508c', 'beb6703e-dcfd-40cd-9151-e1dea48b26e4', 'c3cd67a9-62a6-4416-8be1-cd15cdc45e13'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:59 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719 Feb 24 11:04:59 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:04:59 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:04:59 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:04:59 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8" returned: 0 in 0.573s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "cinder-quobyte-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8" released by "delete_volume" :: held 1.227s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Created reservations ['a2043021-ff1b-47f2-8200-b3541877fa3a', 'c993170d-c47e-4dea-8384-711035999d74', '4aa3642b-e31f-4e42-b712-0afc7c57ed44', 'fe0b2612-0fb3-439b-95a9-ae0d75c0bc54'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:04:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:00 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:00 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:00 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a203d546-b186-4a7b-80d3-4cc9533fc719" returned: 0 in 0.544s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Lock "cinder-quobyte-a203d546-b186-4a7b-80d3-4cc9533fc719" released by "delete_volume" :: held 1.202s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Created reservations ['ddb0542f-febb-4463-bb9a-03a3d85ddf08', '49931a62-edf2-412e-ae9b-03c34ef277d1', 'b974012f-f520-470c-b8d2-1fd68d82b91e', 'c6b4afe3-d23b-4d58-bd1a-a559727d8e09'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:00 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:00 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:00 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.632s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Deleted volume successfully. Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bca507cb-afea-4ef5-9cbc-c2e88748ebfc tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-c1fad0be-6249-441e-920b-1cf8968d88b7-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:00 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.546s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Deleted volume successfully. Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-993cbdb9-e56f-4d24-bd95-547360384f12 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "cinder-d4d4f5b3-bdc5-49f4-8e5e-6a707f3c94e8-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-d9407aba-b000-4db6-9286-382abd9ed5af-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-d9407aba-b000-4db6-9286-382abd9ed5af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-quobyte-d9407aba-b000-4db6-9286-382abd9ed5af" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-d9407aba-b000-4db6-9286-382abd9ed5af" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b75f45-ca53-4cb6-954c-59e54dee6d3e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:00 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af Feb 24 11:05:00 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:00 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.548s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:00 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Deleted volume successfully. Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ddc81884-1c4c-463b-b1e7-b2ad6da316d7 tempest-VolumesTransfersV355Test-1781875089 None] Lock "cinder-a203d546-b186-4a7b-80d3-4cc9533fc719-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Flow 'volume_create_manager' (f8b49b7b-63c4-4710-be39-675ca586b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e8d560-5908-4cbb-b70f-84620399682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e8d560-5908-4cbb-b70f-84620399682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-245622613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8f46f3-2713-4a50-8655-cd02c34eabaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578275f05c5a466aaf80b52f59aba155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:01Z,use_quota=True,user_id='56e85fcea4174d1e98bbd8ff931c46cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2312ef-fff8-4b7b-8e72-ceb28cb4974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2312ef-fff8-4b7b-8e72-ceb28cb4974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f14f467-bb9e-43d4-ac78-a441655845d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f14f467-bb9e-43d4-ac78-a441655845d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8f46f3-2713-4a50-8655-cd02c34eabaf', 'volume_name': 'volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b743c1-374b-4b4d-b9be-2dc539d94872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b743c1-374b-4b4d-b9be-2dc539d94872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e75cfc-eea2-49f7-ac23-8f1abca67678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Volume 4c8f46f3-2713-4a50-8655-cd02c34eabaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf', 'volume_size': 1} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-245622613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8f46f3-2713-4a50-8655-cd02c34eabaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578275f05c5a466aaf80b52f59aba155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:01Z,use_quota=True,user_id='56e85fcea4174d1e98bbd8ff931c46cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Creating volume 4c8f46f3-2713-4a50-8655-cd02c34eabaf {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:01 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:01 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf 1073741824 Feb 24 11:05:01 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:01 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af" returned: 0 in 0.623s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:01 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af Feb 24 11:05:01 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Flow 'volume_create_manager' (5579ecf4-73e0-4844-bf51-fcbe79f8f475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c9597c-52e1-439a-8fcc-0909b4693e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c9597c-52e1-439a-8fcc-0909b4693e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-872329985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a43f25-1569-4bed-9888-74c5dc02107a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb3bf5c3b934881a22fbd5c997a1294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:02Z,use_quota=True,user_id='09205adb9e9d4995b1e937ee7bcd5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad2f199-c78b-4827-84eb-d4267695c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad2f199-c78b-4827-84eb-d4267695c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62a0c36-bfdf-4d98-88f3-98dff94d87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62a0c36-bfdf-4d98-88f3-98dff94d87da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a43f25-1569-4bed-9888-74c5dc02107a', 'volume_name': 'volume-a0a43f25-1569-4bed-9888-74c5dc02107a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687763f3-bae8-4538-90e5-0e0c98d9af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687763f3-bae8-4538-90e5-0e0c98d9af6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f447ed0-e54d-40a7-bb32-368cd9744264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:01 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Volume a0a43f25-1569-4bed-9888-74c5dc02107a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a43f25-1569-4bed-9888-74c5dc02107a', 'volume_size': 1} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:01 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf 1073741824" returned: 0 in 0.670s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:01 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d9407aba-b000-4db6-9286-382abd9ed5af" returned: 0 in 0.583s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-d9407aba-b000-4db6-9286-382abd9ed5af" released by "delete_volume" :: held 1.232s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:01 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf Feb 24 11:05:01 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Created reservations ['92be7b77-f0c8-4f88-b269-7fa43cf3c089', 'dac83ca4-6c03-4574-be91-46a8e280f123', 'e8e3bc70-49de-43ee-aae9-cf8d140afebd', 'a4a858e1-0a28-4db5-a3d7-6a0da9677edc'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:01 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:01 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:02 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf" returned: 0 in 0.484s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-872329985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a43f25-1569-4bed-9888-74c5dc02107a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb3bf5c3b934881a22fbd5c997a1294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:02Z,use_quota=True,user_id='09205adb9e9d4995b1e937ee7bcd5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Creating volume a0a43f25-1569-4bed-9888-74c5dc02107a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:02 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:02 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.421s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:02 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Deleted volume successfully. Feb 24 11:05:02 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a 1073741824 Feb 24 11:05:02 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e75cfc-eea2-49f7-ac23-8f1abca67678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9366c3-83bc-432e-bf5d-d8f060107f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:02 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Volume volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf (4c8f46f3-2713-4a50-8655-cd02c34eabaf): created successfully Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9366c3-83bc-432e-bf5d-d8f060107f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Flow 'volume_create_manager' (f8b49b7b-63c4-4710-be39-675ca586b77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:02 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-58e97db7-34a8-49ad-8fbf-9ffa8fa0cab9 tempest-VolumeQuotasAdminTestJSON-1275709861 None] Created volume successfully. Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bee40f89-2ad0-456a-8230-b0bec20dd883 tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-d9407aba-b000-4db6-9286-382abd9ed5af-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-5c10ab3c-8a81-4c74-8d61-de6d2ed85755-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-5c10ab3c-8a81-4c74-8d61-de6d2ed85755-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-quobyte-5c10ab3c-8a81-4c74-8d61-de6d2ed85755" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-5c10ab3c-8a81-4c74-8d61-de6d2ed85755" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[25314fd4-0403-432a-b1c1-ffca6b0a8ab6]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:02 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a 1073741824" returned: 0 in 0.613s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:02 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 Feb 24 11:05:02 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:02 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a Feb 24 11:05:02 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:03 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755" returned: 0 in 0.646s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:03 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a" returned: 0 in 0.580s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:03 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755 Feb 24 11:05:03 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f447ed0-e54d-40a7-bb32-368cd9744264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a43f25-1569-4bed-9888-74c5dc02107a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac76e945-e0b4-49be-8200-c693e144bd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:03 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Volume volume-a0a43f25-1569-4bed-9888-74c5dc02107a (a0a43f25-1569-4bed-9888-74c5dc02107a): created successfully Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac76e945-e0b4-49be-8200-c693e144bd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:03 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Flow 'volume_create_manager' (5579ecf4-73e0-4844-bf51-fcbe79f8f475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:03 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-20caf444-4dea-4a09-80ab-6099b346049f tempest-VolumesTransfersV355Test-918249420 None] Created volume successfully. Feb 24 11:05:03 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3b025d15-fd89-47ba-8559-5a35f6f1bc9c tempest-VolumeQuotasAdminTestJSON-171153866 None] Transfer volume completed successfully. Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Acquiring lock "cinder-a0a43f25-1569-4bed-9888-74c5dc02107a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Lock "cinder-a0a43f25-1569-4bed-9888-74c5dc02107a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Acquiring lock "cinder-quobyte-a0a43f25-1569-4bed-9888-74c5dc02107a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Lock "cinder-quobyte-a0a43f25-1569-4bed-9888-74c5dc02107a" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad9ed52-3bba-4614-bd0f-6542e781ecaa]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:04 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5c10ab3c-8a81-4c74-8d61-de6d2ed85755" returned: 0 in 0.609s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-5c10ab3c-8a81-4c74-8d61-de6d2ed85755" released by "delete_volume" :: held 1.295s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Created reservations ['88fd68d3-008b-4a4d-ac66-abca8d21dd0f', 'a22850d8-c512-4b10-b5bd-12f353491095', 'e319747b-d2c7-4509-bf8d-127f4dff6a7e', 'd732822c-8d79-44a0-810e-9046b02de694'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:04 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a Feb 24 11:05:04 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:04 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:04 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:04 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a" returned: 0 in 0.505s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:04 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a Feb 24 11:05:04 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:04 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.565s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:04 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Deleted volume successfully. Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Acquiring lock "cinder-4c8f46f3-2713-4a50-8655-cd02c34eabaf-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6e09650c-abd8-44cc-84cc-8a28afeed3f4 tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-5c10ab3c-8a81-4c74-8d61-de6d2ed85755-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Lock "cinder-4c8f46f3-2713-4a50-8655-cd02c34eabaf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Acquiring lock "cinder-quobyte-4c8f46f3-2713-4a50-8655-cd02c34eabaf" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Lock "cinder-quobyte-4c8f46f3-2713-4a50-8655-cd02c34eabaf" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9125f78b-ab22-4625-af7e-e657f82cad8e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-0de18a25-6975-4cb7-b578-1dbb19f7f21c-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-0de18a25-6975-4cb7-b578-1dbb19f7f21c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:05 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf Feb 24 11:05:05 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "cinder-quobyte-0de18a25-6975-4cb7-b578-1dbb19f7f21c" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-0de18a25-6975-4cb7-b578-1dbb19f7f21c" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e448d8b-ac82-4dd7-b067-846ab28f4cfe]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:05 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c Feb 24 11:05:05 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:05 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a0a43f25-1569-4bed-9888-74c5dc02107a" returned: 0 in 0.626s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Lock "cinder-quobyte-a0a43f25-1569-4bed-9888-74c5dc02107a" released by "delete_volume" :: held 1.154s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Created reservations ['75d333c1-a853-4cd6-ab93-d1923ec280d7', '50bc43db-bb8b-432c-ab15-84ea766a5f3b', 'bc512cea-e2e3-4be0-b4dd-56a6f4ee2f98', '6aac00e1-f586-42ba-8615-8348427a8779'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:05 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:05 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:05 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf" returned: 0 in 0.767s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:05 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf Feb 24 11:05:05 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:05 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c" returned: 0 in 0.777s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:05 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c Feb 24 11:05:05 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:06 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.704s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:06 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Deleted volume successfully. Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a30ae812-e851-45cb-a609-c489294ea06b tempest-VolumesTransfersV355Test-1781875089 None] Lock "cinder-a0a43f25-1569-4bed-9888-74c5dc02107a-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:06 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c8f46f3-2713-4a50-8655-cd02c34eabaf" returned: 0 in 0.586s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Lock "cinder-quobyte-4c8f46f3-2713-4a50-8655-cd02c34eabaf" released by "delete_volume" :: held 1.374s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Created reservations ['e00fa02e-df43-46cf-8d2a-50bfd6515f4a', '3749c404-3c45-4799-93ac-486fe13c8d63', '1675e7bb-dd77-4b39-a1af-5f683f87277e', '496a4329-5b0a-4fd1-8882-ca043f249ed0'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:06 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0de18a25-6975-4cb7-b578-1dbb19f7f21c" returned: 0 in 0.549s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-quobyte-0de18a25-6975-4cb7-b578-1dbb19f7f21c" released by "delete_volume" :: held 1.359s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:06 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:06 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Created reservations ['e1c57056-2f0e-421d-82b9-9e36be5eaf63', 'd040a038-5947-497f-851f-0ec203159286', '796d0e50-2c19-4a5f-a6af-bbc0fcc24a73', '9697f732-c9f5-4dd3-b337-6ffe6bf92247'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:06 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:06 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:07 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.583s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:07 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:07 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Deleted volume successfully. Feb 24 11:05:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-320800cb-b664-4d0d-8d2d-68880574fcac tempest-VolumeQuotasAdminTestJSON-1056744159 None] Lock "cinder-4c8f46f3-2713-4a50-8655-cd02c34eabaf-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:07 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.521s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:07 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:07 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Deleted volume successfully. Feb 24 11:05:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ccaef853-18ff-4a0a-8f12-cd0184504a3a tempest-CreateVolumesFromImageTest-871152102 None] Lock "cinder-0de18a25-6975-4cb7-b578-1dbb19f7f21c-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Flow 'volume_create_manager' (542e67de-5475-4de9-8a39-925a55137e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1f53e2-b508-425a-ba0d-902533dc95fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1f53e2-b508-425a-ba0d-902533dc95fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1082896041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51699275-b086-49ef-8ff2-09bd4c74343d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04efa1bbe9694d368b7caaee266236cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:10Z,use_quota=True,user_id='613755d6a2614421907aed300412decb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848dbf7e-1957-4ece-96b4-e4ffa20346b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848dbf7e-1957-4ece-96b4-e4ffa20346b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fe3059-c8f2-4188-84ea-42f07c36fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.image.glance [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Creating Keystone auth plugin from conf {{(pid=82627) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fe3059-c8f2-4188-84ea-42f07c36fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51699275-b086-49ef-8ff2-09bd4c74343d', 'volume_name': 'volume-51699275-b086-49ef-8ff2-09bd4c74343d', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee1e169-92d3-497b-aca5-f270d5e1b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee1e169-92d3-497b-aca5-f270d5e1b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da209540-9df0-4372-8a65-6087a1211246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Volume 51699275-b086-49ef-8ff2-09bd4c74343d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51699275-b086-49ef-8ff2-09bd4c74343d', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Trying to clone 51699275-b086-49ef-8ff2-09bd4c74343d from image 4158f967-877e-452e-b5d3-debeeb743c37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]). {{(pid=82627) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (6bc9727e-4312-4463-bb25-9042d891214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6032ec14-8945-43f2-825d-9740bb8dbe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6032ec14-8945-43f2-825d-9740bb8dbe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1849741173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07278650-8e47-433b-ba4a-af4c00e6888b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:11Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af927be-699c-454a-91d3-0ef9437291d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af927be-699c-454a-91d3-0ef9437291d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4914290-a9a9-412f-9986-6fdd0c24b027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4914290-a9a9-412f-9986-6fdd0c24b027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07278650-8e47-433b-ba4a-af4c00e6888b', 'volume_name': 'volume-07278650-8e47-433b-ba4a-af4c00e6888b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077df4a-4936-4130-bbfa-de9f64b49a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077df4a-4936-4130-bbfa-de9f64b49a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d7a3b4-78b5-425d-b6c1-558c933ae4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:10 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume 07278650-8e47-433b-ba4a-af4c00e6888b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07278650-8e47-433b-ba4a-af4c00e6888b', 'volume_size': 1} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1849741173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07278650-8e47-433b-ba4a-af4c00e6888b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:11Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Creating volume 07278650-8e47-433b-ba4a-af4c00e6888b {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:11 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:11 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b 1073741824 Feb 24 11:05:11 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 24 11:05:11 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Image download 20.69 MB at 20.69 MB/s Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f7a39-ea94-48c0-b5ea-9a6ccb34eb24]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:11 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD Feb 24 11:05:11 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:11 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b 1073741824" returned: 0 in 0.722s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:11 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b Feb 24 11:05:11 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:11 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD" returned: 0 in 0.626s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 is fetched for user 613755d6a2614421907aed300412decb. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b88493-b5ad-4043-bb1a-e97d34136cf0]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:11 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD Feb 24 11:05:11 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:12 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b" returned: 0 in 0.554s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d7a3b4-78b5-425d-b6c1-558c933ae4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07278650-8e47-433b-ba4a-af4c00e6888b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d750a595-4efe-433e-92ba-7507d5cbabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:12 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume volume-07278650-8e47-433b-ba4a-af4c00e6888b (07278650-8e47-433b-ba4a-af4c00e6888b): created successfully Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d750a595-4efe-433e-92ba-7507d5cbabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (6bc9727e-4312-4463-bb25-9042d891214b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:12 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-549eb4e3-31df-43ad-849c-7c66a98cf973 tempest-CreateVolumesFromSnapshotTest-683345538 None] Created volume successfully. Feb 24 11:05:12 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD" returned: 0 in 0.533s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1082896041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51699275-b086-49ef-8ff2-09bd4c74343d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04efa1bbe9694d368b7caaee266236cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:10Z,use_quota=True,user_id='613755d6a2614421907aed300412decb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Creating volume 51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:12 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:12 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d 1073741824 Feb 24 11:05:12 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:13 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d 1073741824" returned: 0 in 0.586s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:13 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:05:13 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Flow 'volume_create_manager' (7f4d6793-daa3-4c1d-94e6-7d7c53d9c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5740673a-24bc-4890-a987-b930bfe027e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5740673a-24bc-4890-a987-b930bfe027e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1823865954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28da933-3c9f-4895-a3a3-28a6bbabe53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32891d1b7e1442c95a34d591241d5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:13Z,use_quota=True,user_id='fa8479ee77d44a16bfb443ee25d35615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbba895-e601-402f-97a4-ecc7b9e564a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbba895-e601-402f-97a4-ecc7b9e564a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b2a41c-d50d-4766-a34d-ebd3bd6b0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b2a41c-d50d-4766-a34d-ebd3bd6b0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28da933-3c9f-4895-a3a3-28a6bbabe53b', 'volume_name': 'volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20ad4dc-98f7-44cd-bbf7-5cb6139b65ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20ad4dc-98f7-44cd-bbf7-5cb6139b65ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ab9ea0-4e9f-4b82-abc0-c1de27dcf3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Volume f28da933-3c9f-4895-a3a3-28a6bbabe53b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b', 'volume_size': 1} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:13 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 0 in 0.516s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.330s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1823865954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28da933-3c9f-4895-a3a3-28a6bbabe53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32891d1b7e1442c95a34d591241d5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:13Z,use_quota=True,user_id='fa8479ee77d44a16bfb443ee25d35615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Creating volume f28da933-3c9f-4895-a3a3-28a6bbabe53b {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:13 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:13 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b 1073741824 Feb 24 11:05:13 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Flow 'volume_create_manager' (d9571aac-189d-4353-8b73-c27d4a8ae197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493603f0-79eb-404a-b105-fe3e72ed11ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493603f0-79eb-404a-b105-fe3e72ed11ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1058466742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0539c3-0220-4064-9ead-d8022a9bfadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b585e293389a4282b8f1be05028048d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:14Z,use_quota=True,user_id='7b0f708d89df4f5ca2cfa4067aa9e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8cbbb7-b9a4-4741-843b-62822acc7a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8cbbb7-b9a4-4741-843b-62822acc7a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9758a00-1904-4001-aa9d-15335c07371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9758a00-1904-4001-aa9d-15335c07371c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0539c3-0220-4064-9ead-d8022a9bfadc', 'volume_name': 'volume-6c0539c3-0220-4064-9ead-d8022a9bfadc', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c048975a-bb1e-4262-87af-fb9aadacd83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c048975a-bb1e-4262-87af-fb9aadacd83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a4f6a7-0e88-4480-8bf7-79a697a41407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:13 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Volume 6c0539c3-0220-4064-9ead-d8022a9bfadc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0539c3-0220-4064-9ead-d8022a9bfadc', 'volume_size': 1} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Attempting download of 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume 51699275-b086-49ef-8ff2-09bd4c74343d. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9a966b-c31f-46dc-ad98-73b4ed7f79ef]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_woi0xe03 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:13 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_woi0xe03 Feb 24 11:05:13 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:14 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b 1073741824" returned: 0 in 0.497s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:14 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b Feb 24 11:05:14 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:14 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_woi0xe03" returned: 0 in 0.452s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_woi0xe03 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:14 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_woi0xe03 Feb 24 11:05:14 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:14 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b" returned: 0 in 0.447s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.295s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Creating offline snapshot d20ba3f5-9b95-4e40-a897-3ffad8a4cacf of volume 07278650-8e47-433b-ba4a-af4c00e6888b {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ab9ea0-4e9f-4b82-abc0-c1de27dcf3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7021ca6d-b28a-4590-b3ce-dbe9ac15b80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[de74f93c-316b-41ef-a4e3-d1dc291a602f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:14 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Volume volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b (f28da933-3c9f-4895-a3a3-28a6bbabe53b): created successfully Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7021ca6d-b28a-4590-b3ce-dbe9ac15b80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Flow 'volume_create_manager' (7f4d6793-daa3-4c1d-94e6-7d7c53d9c62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:14 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-fab798d6-52bc-4a2b-b6f2-ba5b7874b81e tempest-VolumesTransfersV357Test-882832149 None] Created volume successfully. Feb 24 11:05:14 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_woi0xe03" returned: 1 in 0.523s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_woi0xe03' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[79714686-5a59-4a94-adba-a687bfce0b96]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:14 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b Feb 24 11:05:14 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:14 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD Feb 24 11:05:14 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:15 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b" returned: 0 in 0.480s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:15 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf 1G Feb 24 11:05:15 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:15 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:15 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] 4158f967-877e-452e-b5d3-debeeb743c37 was qcow2, converting to raw {{(pid=82627) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 24 11:05:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:15 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:05:15 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:15 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf 1G" returned: 0 in 0.546s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07278650-8e47-433b-ba4a-af4c00e6888b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:15 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07278650-8e47-433b-ba4a-af4c00e6888b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf Feb 24 11:05:15 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0332f673-e511-4243-a20c-e6a4e26c52ca tempest-VolumesTransfersV357Test-211966690 None] Transfer volume completed successfully. Feb 24 11:05:16 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 0 in 0.878s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_iqyb6255devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:05:16 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Converted 112.00 MB image at 112.00 MB/s Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:16 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d 1G Feb 24 11:05:16 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:16 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07278650-8e47-433b-ba4a-af4c00e6888b -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf" returned: 0 in 0.482s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:16 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf is being set with open permissions: ugo+rw Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:16 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf Feb 24 11:05:16 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:16 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d 1G" returned: 0 in 0.439s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dbbb26-c5c5-4db6-bc20-9fc2e28ae7eb]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:16 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf" returned: 0 in 0.444s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:16 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.info Feb 24 11:05:16 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:16 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:05:16 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Acquiring lock "cinder-f28da933-3c9f-4895-a3a3-28a6bbabe53b-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Lock "cinder-f28da933-3c9f-4895-a3a3-28a6bbabe53b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Acquiring lock "cinder-quobyte-f28da933-3c9f-4895-a3a3-28a6bbabe53b" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Lock "cinder-quobyte-f28da933-3c9f-4895-a3a3-28a6bbabe53b" acquired by "delete_volume" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795a66a-b452-4681-b7b2-adc327a1448e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:16 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b Feb 24 11:05:16 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:16 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.info" returned: 0 in 0.412s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:16 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.info is being set with open permissions: ugo+rw Feb 24 11:05:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:17 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.info Feb 24 11:05:17 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:17 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 0 in 0.582s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:17 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:05:17 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:17 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b" returned: 0 in 0.503s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:17 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b Feb 24 11:05:17 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:17 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.info" returned: 0 in 0.384s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.731s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1058466742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0539c3-0220-4064-9ead-d8022a9bfadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b585e293389a4282b8f1be05028048d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:14Z,use_quota=True,user_id='7b0f708d89df4f5ca2cfa4067aa9e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Creating volume 6c0539c3-0220-4064-9ead-d8022a9bfadc {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:17 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:17 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc 1073741824 Feb 24 11:05:17 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:17 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c1c53135-baea-4e7b-a71c-ac96294ddef0 tempest-CreateVolumesFromSnapshotTest-683345538 None] Create snapshot completed successfully Feb 24 11:05:17 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 1 in 0.482s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Downloaded image 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume 51699275-b086-49ef-8ff2-09bd4c74343d successfully. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 for user 613755d6a2614421907aed300412decb is deleted. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Marking volume 51699275-b086-49ef-8ff2-09bd4c74343d as bootable. {{(pid=82627) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Copying metadata from image 4158f967-877e-452e-b5d3-debeeb743c37 to 51699275-b086-49ef-8ff2-09bd4c74343d. {{(pid=82627) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Creating volume glance metadata for volume 51699275-b086-49ef-8ff2-09bd4c74343d backed by image 4158f967-877e-452e-b5d3-debeeb743c37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82627) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 24 11:05:17 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f28da933-3c9f-4895-a3a3-28a6bbabe53b" returned: 0 in 0.419s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da209540-9df0-4372-8a65-6087a1211246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51699275-b086-49ef-8ff2-09bd4c74343d', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8593350d-56a2-41c3-95c9-43d3fc730e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Lock "cinder-quobyte-f28da933-3c9f-4895-a3a3-28a6bbabe53b" released by "delete_volume" :: held 0.965s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:17 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Volume volume-51699275-b086-49ef-8ff2-09bd4c74343d (51699275-b086-49ef-8ff2-09bd4c74343d): created successfully Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8593350d-56a2-41c3-95c9-43d3fc730e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Flow 'volume_create_manager' (542e67de-5475-4de9-8a39-925a55137e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:17 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5713f9e3-9751-4997-877e-8b86f580938c tempest-TestVolumeBootPattern-1051066020 None] Created volume successfully. Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Created reservations ['b08afbc2-2a7f-4f04-b971-600d2a96b959', 'd9f06e8d-d571-4896-bcd9-d79d68919b0d', '88fa4408-c634-4291-9af8-464eceecb579', '07af3036-e651-4185-9a81-be2551c2ee49'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:17 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:17 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:17 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc 1073741824" returned: 0 in 0.518s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:17 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc Feb 24 11:05:17 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:18 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.490s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:18 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Deleted volume successfully. Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2bde4d-a855-4a4d-ac30-4fd7087805cb tempest-VolumesTransfersV357Test-357943867 None] Lock "cinder-f28da933-3c9f-4895-a3a3-28a6bbabe53b-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:18 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc" returned: 0 in 0.453s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a4f6a7-0e88-4480-8bf7-79a697a41407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0539c3-0220-4064-9ead-d8022a9bfadc', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a763aaca-0416-4b92-b659-6f4b82296fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:18 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Volume volume-6c0539c3-0220-4064-9ead-d8022a9bfadc (6c0539c3-0220-4064-9ead-d8022a9bfadc): created successfully Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a763aaca-0416-4b92-b659-6f4b82296fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Flow 'volume_create_manager' (d9571aac-189d-4353-8b73-c27d4a8ae197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:18 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4ce08153-bdf3-4f8c-ac6d-7440d54d11f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Created volume successfully. Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (2e8e099a-ebe0-46a2-b1bc-1fb9384a45c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8895ccd6-3ba3-4b52-bc6b-5b995431c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8895ccd6-3ba3-4b52-bc6b-5b995431c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052642481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72442702-00cb-4f33-b4f6-66f02d2d5b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:19Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059de901-871f-4901-b39c-4b0f139a1c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059de901-871f-4901-b39c-4b0f139a1c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca51755f-bcb8-46b0-ab0b-32218c2914bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca51755f-bcb8-46b0-ab0b-32218c2914bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72442702-00cb-4f33-b4f6-66f02d2d5b20', 'volume_name': 'volume-72442702-00cb-4f33-b4f6-66f02d2d5b20', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e60b252-23ad-40a8-96c0-78685dbed4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e60b252-23ad-40a8-96c0-78685dbed4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a8d60a-a407-4bad-9fa8-ead766a5e5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:18 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume 72442702-00cb-4f33-b4f6-66f02d2d5b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72442702-00cb-4f33-b4f6-66f02d2d5b20', 'volume_size': 1} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052642481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72442702-00cb-4f33-b4f6-66f02d2d5b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:19Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Creating volume 72442702-00cb-4f33-b4f6-66f02d2d5b20 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:18 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:18 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 1073741824 Feb 24 11:05:18 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (80f6e0d9-6574-45dd-af7a-9493ab28e45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6590752-19cd-41c7-9702-6aba0c8775c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:18 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=193,cinder:INSERT=74,cinder:UPDATE=231,cinder:DELETE=17 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6590752-19cd-41c7-9702-6aba0c8775c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313375104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d300a728-f99d-4467-94ce-5a27f376bf4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:19Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1f420c-d10e-4942-b505-0587fb40eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1f420c-d10e-4942-b505-0587fb40eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395715a5-b718-4111-8b84-beefa7884cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395715a5-b718-4111-8b84-beefa7884cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd300a728-f99d-4467-94ce-5a27f376bf4a', 'volume_name': 'volume-d300a728-f99d-4467-94ce-5a27f376bf4a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b7ba32-c8cc-4d6b-9723-1bed1476f351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b7ba32-c8cc-4d6b-9723-1bed1476f351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533d9a4c-0b5e-4de7-9d4c-d002fa114dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume d300a728-f99d-4467-94ce-5a27f376bf4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d300a728-f99d-4467-94ce-5a27f376bf4a', 'volume_size': 1} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=189,cinder:INSERT=62,cinder:UPDATE=240,cinder:DELETE=23 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (9fb78d87-4f6c-4d82-a960-f312341dded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c92d89f-d2b4-44ec-82cf-f6aa7a4b3fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c92d89f-d2b4-44ec-82cf-f6aa7a4b3fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1929059628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd49074-790d-4191-bd5f-9c706f2c8463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:19Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7747eb99-4f8b-4cba-ac93-c78633e9277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7747eb99-4f8b-4cba-ac93-c78633e9277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eadffa5c-48cf-4f33-b39a-cc53b8a0ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eadffa5c-48cf-4f33-b39a-cc53b8a0ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd49074-790d-4191-bd5f-9c706f2c8463', 'volume_name': 'volume-2fd49074-790d-4191-bd5f-9c706f2c8463', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bac2dff-20b3-47cb-b5cc-a63a10d122d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bac2dff-20b3-47cb-b5cc-a63a10d122d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa437956-00d2-40f3-a770-42ecd8361d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume 2fd49074-790d-4191-bd5f-9c706f2c8463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd49074-790d-4191-bd5f-9c706f2c8463', 'volume_size': 1} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 1073741824" returned: 0 in 0.734s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Flow 'volume_create_manager' (2886386f-ac59-4a84-b339-2162aae3200e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d86f7ea-11fd-4110-b746-e45f9021b3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d86f7ea-11fd-4110-b746-e45f9021b3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2143746537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09467615-9e4e-4101-8bfa-6055f9ec972b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32891d1b7e1442c95a34d591241d5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:19Z,use_quota=True,user_id='fa8479ee77d44a16bfb443ee25d35615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2fb864-a7aa-4938-91e3-4aff67210e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2fb864-a7aa-4938-91e3-4aff67210e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79ee660-451d-4a51-ad37-1e3f866f3f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79ee660-451d-4a51-ad37-1e3f866f3f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09467615-9e4e-4101-8bfa-6055f9ec972b', 'volume_name': 'volume-09467615-9e4e-4101-8bfa-6055f9ec972b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a0a18a-f4e1-4195-99bd-83bf14459e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a0a18a-f4e1-4195-99bd-83bf14459e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50727795-529b-4f8d-b240-cd3070947587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Volume 09467615-9e4e-4101-8bfa-6055f9ec972b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09467615-9e4e-4101-8bfa-6055f9ec972b', 'volume_size': 1} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:19 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 Feb 24 11:05:19 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (1e0edf6b-fb6a-499d-a0d1-6a8bdafea8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853e549e-03ca-48ad-9e09-5129cf567a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853e549e-03ca-48ad-9e09-5129cf567a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2096315814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:20Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc65fd5-2c9e-4c68-930b-c5d662afec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc65fd5-2c9e-4c68-930b-c5d662afec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c71284-4c80-4ee9-9bdb-64c8141edcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c71284-4c80-4ee9-9bdb-64c8141edcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7', 'volume_name': 'volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080858bc-a1e4-4d13-bbfe-37b52a85ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080858bc-a1e4-4d13-bbfe-37b52a85ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac71c4ac-772b-453f-8d23-971466a4e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7', 'volume_size': 1} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (4cd7f0de-350b-4943-bb02-fe430a4bc663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61ad620-d392-44de-8626-e96c075c86b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61ad620-d392-44de-8626-e96c075c86b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2076510320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b588222e-1519-48b0-9f6f-3f36f133e8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:20Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fb747a-521f-4c77-9ae5-57899350fdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fb747a-521f-4c77-9ae5-57899350fdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e6ca76-0e3e-40c0-a508-2048281e6227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e6ca76-0e3e-40c0-a508-2048281e6227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b588222e-1519-48b0-9f6f-3f36f133e8f8', 'volume_name': 'volume-b588222e-1519-48b0-9f6f-3f36f133e8f8', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4674b2de-08af-444d-bbd1-2a186ca6c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4674b2de-08af-444d-bbd1-2a186ca6c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce5d3a4-9837-458c-b11a-11383fe08b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:19 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume b588222e-1519-48b0-9f6f-3f36f133e8f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b588222e-1519-48b0-9f6f-3f36f133e8f8', 'volume_size': 1} Feb 24 11:05:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:20 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20" returned: 0 in 0.496s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313375104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d300a728-f99d-4467-94ce-5a27f376bf4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:19Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Creating volume d300a728-f99d-4467-94ce-5a27f376bf4a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:20 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a8d60a-a407-4bad-9fa8-ead766a5e5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72442702-00cb-4f33-b4f6-66f02d2d5b20', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602615ab-893d-43a3-9b6a-37508c80a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:20 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a 1073741824 Feb 24 11:05:20 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:20 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 (72442702-00cb-4f33-b4f6-66f02d2d5b20): created successfully Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602615ab-893d-43a3-9b6a-37508c80a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (2e8e099a-ebe0-46a2-b1bc-1fb9384a45c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:20 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7c2607ec-ea28-49f7-ab38-129df796a2f7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Created volume successfully. Feb 24 11:05:20 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a 1073741824" returned: 0 in 0.561s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:20 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a Feb 24 11:05:20 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:21 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a" returned: 0 in 0.442s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1929059628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd49074-790d-4191-bd5f-9c706f2c8463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:19Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Creating volume 2fd49074-790d-4191-bd5f-9c706f2c8463 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:21 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533d9a4c-0b5e-4de7-9d4c-d002fa114dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d300a728-f99d-4467-94ce-5a27f376bf4a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:21 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 1073741824 Feb 24 11:05:21 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e77e26-58dd-4e42-9927-ac5150a15eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:21 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume volume-d300a728-f99d-4467-94ce-5a27f376bf4a (d300a728-f99d-4467-94ce-5a27f376bf4a): created successfully Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e77e26-58dd-4e42-9927-ac5150a15eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (80f6e0d9-6574-45dd-af7a-9493ab28e45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6afc480f-22d4-4107-85f5-156a6a028c08 tempest-CreateVolumesFromSnapshotTest-683345538 None] Created volume successfully. Feb 24 11:05:21 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 1073741824" returned: 0 in 0.548s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:21 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 Feb 24 11:05:21 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:22 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463" returned: 0 in 0.472s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.674s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa437956-00d2-40f3-a770-42ecd8361d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd49074-790d-4191-bd5f-9c706f2c8463', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6563ae42-e8b5-4148-874e-41361f8ae728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Creating offline snapshot fc49b78c-c6c0-4189-8616-83a36f0ddf76 of volume 6c0539c3-0220-4064-9ead-d8022a9bfadc {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:05:22 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume volume-2fd49074-790d-4191-bd5f-9c706f2c8463 (2fd49074-790d-4191-bd5f-9c706f2c8463): created successfully Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6563ae42-e8b5-4148-874e-41361f8ae728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (9fb78d87-4f6c-4d82-a960-f312341dded0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[069172df-c4c2-45a7-846d-817f476e28c1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:22 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4de08e57-c993-492e-b499-c68253f45d81 tempest-CreateVolumesFromSnapshotTest-683345538 None] Created volume successfully. Feb 24 11:05:22 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc Feb 24 11:05:22 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:22 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc" returned: 0 in 0.531s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:22 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 1G Feb 24 11:05:22 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:23 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 1G" returned: 0 in 0.482s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0539c3-0220-4064-9ead-d8022a9bfadc -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:23 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0539c3-0220-4064-9ead-d8022a9bfadc -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 Feb 24 11:05:23 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:23 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0539c3-0220-4064-9ead-d8022a9bfadc -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76" returned: 0 in 0.449s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:23 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 is being set with open permissions: ugo+rw Feb 24 11:05:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:23 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 Feb 24 11:05:23 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:24 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76" returned: 0 in 0.415s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:24 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.info Feb 24 11:05:24 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:24 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.info" returned: 0 in 0.421s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:24 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.info is being set with open permissions: ugo+rw Feb 24 11:05:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:24 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.info Feb 24 11:05:24 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:25 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.info" returned: 0 in 0.462s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.450s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2143746537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09467615-9e4e-4101-8bfa-6055f9ec972b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32891d1b7e1442c95a34d591241d5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:19Z,use_quota=True,user_id='fa8479ee77d44a16bfb443ee25d35615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Creating volume 09467615-9e4e-4101-8bfa-6055f9ec972b {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:25 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:25 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b 1073741824 Feb 24 11:05:25 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:25 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4b3db510-d240-4d18-943c-2373645b150d tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Create snapshot completed successfully Feb 24 11:05:25 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b 1073741824" returned: 0 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:25 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b Feb 24 11:05:25 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "cinder-fc49b78c-c6c0-4189-8616-83a36f0ddf76-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-fc49b78c-c6c0-4189-8616-83a36f0ddf76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "cinder-quobyte-6c0539c3-0220-4064-9ead-d8022a9bfadc" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-quobyte-6c0539c3-0220-4064-9ead-d8022a9bfadc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "cinder-quobyte-fc49b78c-c6c0-4189-8616-83a36f0ddf76" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-quobyte-fc49b78c-c6c0-4189-8616-83a36f0ddf76" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Deleting offline snapshot fc49b78c-c6c0-4189-8616-83a36f0ddf76 of volume 6c0539c3-0220-4064-9ead-d8022a9bfadc {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] snapshot_file for this snap is: volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5f1cd6-0b0a-4db2-ae5a-cc4413c06ebe]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:26 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 Feb 24 11:05:26 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:26 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b" returned: 0 in 0.535s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.432s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2096315814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:20Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Creating volume f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:26 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50727795-529b-4f8d-b240-cd3070947587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09467615-9e4e-4101-8bfa-6055f9ec972b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6adbab6-c4c0-4a5c-b647-bfc2ff1e3581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:26 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 1073741824 Feb 24 11:05:26 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:26 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Volume volume-09467615-9e4e-4101-8bfa-6055f9ec972b (09467615-9e4e-4101-8bfa-6055f9ec972b): created successfully Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6adbab6-c4c0-4a5c-b647-bfc2ff1e3581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Flow 'volume_create_manager' (2886386f-ac59-4a84-b339-2162aae3200e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:26 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ebf38844-a367-497e-a82a-8e7371b21cda tempest-VolumesTransfersV357Test-882832149 None] Created volume successfully. Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:26 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76" returned: 0 in 0.542s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0539c3-0220-4064-9ead-d8022a9bfadc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a98edf-25da-442d-a6b9-4b6384a0a562]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:26 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc Feb 24 11:05:26 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:26 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 1073741824" returned: 0 in 0.583s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:26 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 Feb 24 11:05:26 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Acquiring lock "cinder-09467615-9e4e-4101-8bfa-6055f9ec972b-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Lock "cinder-09467615-9e4e-4101-8bfa-6055f9ec972b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Acquiring lock "cinder-quobyte-09467615-9e4e-4101-8bfa-6055f9ec972b" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Lock "cinder-quobyte-09467615-9e4e-4101-8bfa-6055f9ec972b" acquired by "delete_volume" :: waited 0.027s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1bdc1a-5b25-4e54-9080-f9470735e971]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:27 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b Feb 24 11:05:27 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:27 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc" returned: 0 in 0.631s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:27 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 Feb 24 11:05:27 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:27 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7" returned: 0 in 0.513s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.369s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2076510320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b588222e-1519-48b0-9f6f-3f36f133e8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f40a5cdd14e62be4dc7f8434a4255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:20Z,use_quota=True,user_id='60247ea208014c56b312ce1cbe69db0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Creating volume b588222e-1519-48b0-9f6f-3f36f133e8f8 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:27 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac71c4ac-772b-453f-8d23-971466a4e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64607db0-4aad-476e-9750-ab2af77d5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:27 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 (f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7): created successfully Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64607db0-4aad-476e-9750-ab2af77d5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (1e0edf6b-fb6a-499d-a0d1-6a8bdafea8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:27 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 1073741824 Feb 24 11:05:27 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-de5f0f78-3e1b-40b0-84ae-7fa458848c7d tempest-CreateVolumesFromSnapshotTest-683345538 None] Created volume successfully. Feb 24 11:05:27 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b" returned: 0 in 0.555s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:27 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b Feb 24 11:05:27 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:27 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76" returned: 0 in 0.578s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:27 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76 Feb 24 11:05:27 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:27 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 1073741824" returned: 0 in 0.521s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:27 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 Feb 24 11:05:27 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:28 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-09467615-9e4e-4101-8bfa-6055f9ec972b" returned: 0 in 0.508s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Lock "cinder-quobyte-09467615-9e4e-4101-8bfa-6055f9ec972b" released by "delete_volume" :: held 1.096s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Created reservations ['93d3f83e-5841-4b34-b24c-a0105a574557', '03dd2ac4-1758-47ef-86b6-1c5ed2af1f4b', '38e8769f-4b61-41c2-95e7-02f0722861c0', '6001b56f-7846-4134-9180-fcbb4d9487ce'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:28 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:28 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:28 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8" returned: 0 in 0.475s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.922s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce5d3a4-9837-458c-b11a-11383fe08b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b588222e-1519-48b0-9f6f-3f36f133e8f8', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb103b8-613b-4f81-87df-590944adeb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e449f5-1ced-4a5b-a3b8-300bcad06a79]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:28 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc.fc49b78c-c6c0-4189-8616-83a36f0ddf76" returned: 0 in 0.644s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:28 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Volume volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 (b588222e-1519-48b0-9f6f-3f36f133e8f8): created successfully Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb103b8-613b-4f81-87df-590944adeb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Flow 'volume_create_manager' (4cd7f0de-350b-4943-bb02-fe430a4bc663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-457b2707-1b9b-4e98-8e07-c23c9e983c3c tempest-CreateVolumesFromSnapshotTest-683345538 None] Created volume successfully. Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-quobyte-fc49b78c-c6c0-4189-8616-83a36f0ddf76" released by "_delete_snapshot" :: held 2.513s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-quobyte-6c0539c3-0220-4064-9ead-d8022a9bfadc" released by "delete_snapshot" :: held 2.540s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:28 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:05:28 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Created reservations ['8b2faf53-fa6e-4671-a30f-1fc6950f4846', 'f839c7cb-c25c-43b6-8172-70b0cab59e2f', 'a47dc45d-0fbe-4577-8fcb-9fcaf6d57e18', '0d98a92f-4917-440e-b535-443a38edfe20'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Delete snapshot completed successfully. Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8a2408c6-2cd6-4b0d-ac5c-fc4191cfa15e tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-fc49b78c-c6c0-4189-8616-83a36f0ddf76-delete_snapshot" released by "delete_snapshot" :: held 2.682s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:28 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.498s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Deleted volume successfully. Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fb00bc56-63c3-40b0-a5e7-5dd212523277 tempest-VolumesTransfersV357Test-357943867 None] Lock "cinder-09467615-9e4e-4101-8bfa-6055f9ec972b-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:28 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 0 in 0.607s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:29 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:05:29 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "cinder-6c0539c3-0220-4064-9ead-d8022a9bfadc-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-6c0539c3-0220-4064-9ead-d8022a9bfadc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "cinder-quobyte-6c0539c3-0220-4064-9ead-d8022a9bfadc" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-quobyte-6c0539c3-0220-4064-9ead-d8022a9bfadc" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f007f2f3-9c0e-4331-a2fa-54d97e50171d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:29 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc Feb 24 11:05:29 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:29 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 1 in 0.554s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.214s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37', 'name': 'volume-51699275-b086-49ef-8ff2-09bd4c74343d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cad52321-e726-440a-93e3-282005ab404e', 'enforce_multipath': True} {{(pid=82627) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-b588222e-1519-48b0-9f6f-3f36f133e8f8-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-b588222e-1519-48b0-9f6f-3f36f133e8f8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-quobyte-b588222e-1519-48b0-9f6f-3f36f133e8f8" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:29 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-817c981b-2ecd-4118-8e52-554251883887 req-271b49c1-fbd6-45e5-b4d5-c544b3800091 tempest-TestVolumeBootPattern-1051066020 None] attachment_update completed successfully. Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-b588222e-1519-48b0-9f6f-3f36f133e8f8" acquired by "delete_volume" :: waited 0.029s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5c0461-666a-43e5-9fcb-68a7227a357b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:29 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 Feb 24 11:05:29 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:29 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc" returned: 0 in 0.565s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:29 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc Feb 24 11:05:29 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:30 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6c0539c3-0220-4064-9ead-d8022a9bfadc" returned: 0 in 0.443s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-quobyte-6c0539c3-0220-4064-9ead-d8022a9bfadc" released by "delete_volume" :: held 1.055s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Created reservations ['58674006-df50-466d-9378-8f01868962a8', '6adf83d5-624b-4885-b8d8-2f810091c110', '88d96392-3b42-41e7-ba4c-5f4108571114', 'd8259a66-f7d9-40ab-9690-fdcc514f0bad'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:30 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8" returned: 0 in 0.626s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:30 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8 Feb 24 11:05:30 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:30 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:30 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:30 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b588222e-1519-48b0-9f6f-3f36f133e8f8" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-b588222e-1519-48b0-9f6f-3f36f133e8f8" released by "delete_volume" :: held 1.130s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Created reservations ['659f35a5-ec9e-4576-bd1d-048a2a732d99', '25f324d9-7e26-4572-a3e6-e575e27df217', 'd43fa7bb-affa-44e2-84c4-f98ff272e446', '70887c69-5a37-4822-a8d6-fdbb4a41337d'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:30 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:30 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:30 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.588s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:30 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Deleted volume successfully. Feb 24 11:05:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7fd4c812-1c44-40da-ab3e-fba713eaa767 tempest-VolumeSnapshotQuotasNegativeTestJSON-293628098 None] Lock "cinder-6c0539c3-0220-4064-9ead-d8022a9bfadc-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:31 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.571s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:31 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Deleted volume successfully. Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93f0054a-7de0-47a7-8ec6-54e471a2b09c tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-b588222e-1519-48b0-9f6f-3f36f133e8f8-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-quobyte-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16e6f51-4c76-4741-b958-6565def390de]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:31 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 Feb 24 11:05:31 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:32 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7" returned: 0 in 0.628s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:32 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7 Feb 24 11:05:32 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:32 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7" returned: 0 in 0.512s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7" released by "delete_volume" :: held 1.169s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Created reservations ['946df9d0-5cbd-4b56-97e8-afd9b27592ac', '7c180e87-e683-4ef6-8e02-a72c2879b752', 'a11ef692-d861-4c05-b45b-9341e98e80e3', '56bcee00-8f70-40a4-9f6f-999e67c504a7'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:33 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:33 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Flow 'volume_create_manager' (da21bce4-a57d-45cf-aebb-1647caac5bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db485743-405e-4d23-8277-417b1ff1edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db485743-405e-4d23-8277-417b1ff1edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1508262054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9b13ef-ccd6-4e00-a738-1225dbb25769,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='727f911f45ba491d9ef30b1d69556831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:33Z,use_quota=True,user_id='4eeb6d37e6f34329a03c604ebcab1f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2411fdfa-f6b3-42a7-b1d0-a79fc92506f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2411fdfa-f6b3-42a7-b1d0-a79fc92506f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75005609-3673-40e0-a493-273f15ea3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75005609-3673-40e0-a493-273f15ea3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9b13ef-ccd6-4e00-a738-1225dbb25769', 'volume_name': 'volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a1107a-b6d9-4fe5-b6be-45e4d019f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a1107a-b6d9-4fe5-b6be-45e4d019f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0b421d-cd67-4af7-a062-1098a3e9da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:33 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Volume 4c9b13ef-ccd6-4e00-a738-1225dbb25769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769', 'volume_size': 1} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1508262054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9b13ef-ccd6-4e00-a738-1225dbb25769,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='727f911f45ba491d9ef30b1d69556831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:33Z,use_quota=True,user_id='4eeb6d37e6f34329a03c604ebcab1f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Creating volume 4c9b13ef-ccd6-4e00-a738-1225dbb25769 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:33 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:33 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 1073741824 Feb 24 11:05:33 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:33 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.523s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Deleted volume successfully. Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53a0a064-1d88-4620-9998-9b600ea0ccc7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-f15b3d6a-cffb-4bc3-9d59-64d5ec2e3ae7-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-2fd49074-790d-4191-bd5f-9c706f2c8463-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-2fd49074-790d-4191-bd5f-9c706f2c8463-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:34 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 1073741824" returned: 0 in 0.596s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-quobyte-2fd49074-790d-4191-bd5f-9c706f2c8463" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-2fd49074-790d-4191-bd5f-9c706f2c8463" acquired by "delete_volume" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9cfa55-5eee-4bd9-b957-f7a95a01917f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:34 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 Feb 24 11:05:34 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:34 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:34 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:34 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 Feb 24 11:05:34 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:34 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769" returned: 0 in 0.824s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:34 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:34 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0b421d-cd67-4af7-a062-1098a3e9da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c47a140-31e7-4ed3-947a-ff2e688dd6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463" returned: 0 in 0.867s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.893s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:34 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Volume volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 (4c9b13ef-ccd6-4e00-a738-1225dbb25769): created successfully Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c47a140-31e7-4ed3-947a-ff2e688dd6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Flow 'volume_create_manager' (da21bce4-a57d-45cf-aebb-1647caac5bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:35 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-22b908d4-ec0a-4e9b-adce-b771e675f3b0 tempest-VolumesListTestJSON-1651339302 None] Created volume successfully. Feb 24 11:05:35 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463 Feb 24 11:05:35 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:35 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fd49074-790d-4191-bd5f-9c706f2c8463" returned: 0 in 0.608s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-2fd49074-790d-4191-bd5f-9c706f2c8463" released by "delete_volume" :: held 1.530s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Created reservations ['0d58732e-e9a2-4b3a-803b-97b00acb3d87', '01cbcac8-80d3-4b05-9767-bab009194841', 'a176130d-4331-4bda-8f74-8a0a8b3571d2', 'c38286e4-d93e-447c-b27e-664ab77d988c'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:35 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:35 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:35 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Flow 'volume_create_manager' (8bd93191-8086-4317-94e1-289eea6148e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66371cb-f99d-4a85-bfac-1c4aa7bf0d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66371cb-f99d-4a85-bfac-1c4aa7bf0d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-871317228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a08cd6-6762-4697-88a2-f6252bcb0e86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='727f911f45ba491d9ef30b1d69556831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:36Z,use_quota=True,user_id='4eeb6d37e6f34329a03c604ebcab1f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282ae3dd-f0b3-4c5c-8928-9bc44f496d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282ae3dd-f0b3-4c5c-8928-9bc44f496d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c69ceef-0c76-4e5c-b7a8-d90b674eda34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c69ceef-0c76-4e5c-b7a8-d90b674eda34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a08cd6-6762-4697-88a2-f6252bcb0e86', 'volume_name': 'volume-39a08cd6-6762-4697-88a2-f6252bcb0e86', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b74942-6529-4df9-ba60-158970e67b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b74942-6529-4df9-ba60-158970e67b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92f21d9-eb68-4cb6-9926-3284d79fafdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:36 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Volume 39a08cd6-6762-4697-88a2-f6252bcb0e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a08cd6-6762-4697-88a2-f6252bcb0e86', 'volume_size': 1} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-871317228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a08cd6-6762-4697-88a2-f6252bcb0e86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='727f911f45ba491d9ef30b1d69556831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:36Z,use_quota=True,user_id='4eeb6d37e6f34329a03c604ebcab1f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Creating volume 39a08cd6-6762-4697-88a2-f6252bcb0e86 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:36 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:36 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 1073741824 Feb 24 11:05:36 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-d300a728-f99d-4467-94ce-5a27f376bf4a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-d300a728-f99d-4467-94ce-5a27f376bf4a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-quobyte-d300a728-f99d-4467-94ce-5a27f376bf4a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-d300a728-f99d-4467-94ce-5a27f376bf4a" acquired by "delete_volume" :: waited 0.031s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd9b05-e1e2-4c45-81e7-c0ee95cc5703]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:36 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a Feb 24 11:05:36 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:36 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.978s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:36 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Deleted volume successfully. Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-239e8270-99f8-4c2d-9fd5-490c97316bb7 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-2fd49074-790d-4191-bd5f-9c706f2c8463-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:36 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 1073741824" returned: 0 in 0.894s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:37 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 Feb 24 11:05:37 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:37 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a" returned: 0 in 0.827s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:37 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a Feb 24 11:05:37 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:37 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86" returned: 0 in 0.604s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92f21d9-eb68-4cb6-9926-3284d79fafdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a08cd6-6762-4697-88a2-f6252bcb0e86', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26494428-2c77-4c06-a713-066a4e966a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:37 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Volume volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 (39a08cd6-6762-4697-88a2-f6252bcb0e86): created successfully Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26494428-2c77-4c06-a713-066a4e966a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Flow 'volume_create_manager' (8bd93191-8086-4317-94e1-289eea6148e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:37 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-78d98fc4-fa39-4166-9feb-62a474bcb0b7 tempest-VolumesListTestJSON-1651339302 None] Created volume successfully. Feb 24 11:05:37 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d300a728-f99d-4467-94ce-5a27f376bf4a" returned: 0 in 0.626s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-d300a728-f99d-4467-94ce-5a27f376bf4a" released by "delete_volume" :: held 1.486s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Created reservations ['cd85c4b3-bcdc-4b13-bb15-126f2d69d576', '6174a10d-35ea-48d4-ad6d-e2f8482be2a5', 'ee864672-a02b-4fa3-945e-15f7407f6517', 'ac387e09-14c2-44df-936e-2038a04607e3'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:38 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:38 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:38 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.628s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:38 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Deleted volume successfully. Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-b3e11cb5-cc4d-409c-8473-ae3677238711 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-d300a728-f99d-4467-94ce-5a27f376bf4a-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Flow 'volume_create_manager' (1a76a2df-05a7-4b57-a946-a1f225894ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b380c1-ed73-4e25-a112-2b7cafa54170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-72442702-00cb-4f33-b4f6-66f02d2d5b20-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b380c1-ed73-4e25-a112-2b7cafa54170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-376608597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d31b7f9-5733-4a61-97f8-d5268da7f029,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='727f911f45ba491d9ef30b1d69556831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:39Z,use_quota=True,user_id='4eeb6d37e6f34329a03c604ebcab1f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048fe55d-2d97-40cf-8fca-e57341f35eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048fe55d-2d97-40cf-8fca-e57341f35eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7541542e-5438-46ef-8a67-c3a5b89ceba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7541542e-5438-46ef-8a67-c3a5b89ceba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d31b7f9-5733-4a61-97f8-d5268da7f029', 'volume_name': 'volume-5d31b7f9-5733-4a61-97f8-d5268da7f029', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19610685-127d-473e-9db7-f51b64421c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19610685-127d-473e-9db7-f51b64421c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755f8f5e-0a8b-4aaa-a4b1-71b6e0437a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:38 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Volume 5d31b7f9-5733-4a61-97f8-d5268da7f029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d31b7f9-5733-4a61-97f8-d5268da7f029', 'volume_size': 1} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-376608597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d31b7f9-5733-4a61-97f8-d5268da7f029,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='727f911f45ba491d9ef30b1d69556831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:39Z,use_quota=True,user_id='4eeb6d37e6f34329a03c604ebcab1f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Creating volume 5d31b7f9-5733-4a61-97f8-d5268da7f029 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:38 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-72442702-00cb-4f33-b4f6-66f02d2d5b20-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:38 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 1073741824 Feb 24 11:05:38 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-quobyte-72442702-00cb-4f33-b4f6-66f02d2d5b20" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-72442702-00cb-4f33-b4f6-66f02d2d5b20" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24e5df-19a9-4765-865f-bae588e85702]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:39 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 Feb 24 11:05:39 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:39 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 1073741824" returned: 0 in 0.737s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:39 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 Feb 24 11:05:39 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:39 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20" returned: 0 in 0.720s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:39 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20 Feb 24 11:05:39 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:40 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-72442702-00cb-4f33-b4f6-66f02d2d5b20" returned: 0 in 0.507s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-72442702-00cb-4f33-b4f6-66f02d2d5b20" released by "delete_volume" :: held 1.254s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:40 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029" returned: 0 in 0.647s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755f8f5e-0a8b-4aaa-a4b1-71b6e0437a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d31b7f9-5733-4a61-97f8-d5268da7f029', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9575803e-108b-407a-8ae5-ca6d48011cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Created reservations ['99e2d066-086f-4774-b8ec-862d63efb9e2', '7bcbbb1b-0ae0-4f27-8140-db0a98be724d', '2f6cb0a4-caf6-4498-b4f4-66598612936b', '0acdcf46-1023-4c21-942e-380432d20ea3'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:40 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Volume volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 (5d31b7f9-5733-4a61-97f8-d5268da7f029): created successfully Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9575803e-108b-407a-8ae5-ca6d48011cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Flow 'volume_create_manager' (1a76a2df-05a7-4b57-a946-a1f225894ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:40 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-80aa2f7f-dce1-4138-8fe9-73a35407f53d tempest-VolumesListTestJSON-1651339302 None] Created volume successfully. Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:40 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:40 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:40 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.616s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:40 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Deleted volume successfully. Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-526a2ef8-a03c-42bd-8595-922e932650de tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-72442702-00cb-4f33-b4f6-66f02d2d5b20-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-d20ba3f5-9b95-4e40-a897-3ffad8a4cacf-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-d20ba3f5-9b95-4e40-a897-3ffad8a4cacf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-quobyte-07278650-8e47-433b-ba4a-af4c00e6888b" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-07278650-8e47-433b-ba4a-af4c00e6888b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-quobyte-d20ba3f5-9b95-4e40-a897-3ffad8a4cacf" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-d20ba3f5-9b95-4e40-a897-3ffad8a4cacf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Deleting offline snapshot d20ba3f5-9b95-4e40-a897-3ffad8a4cacf of volume 07278650-8e47-433b-ba4a-af4c00e6888b {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] snapshot_file for this snap is: volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e27acb7-3391-4b09-b835-a9daf06bab77]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:41 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf Feb 24 11:05:41 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:41 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf" returned: 0 in 0.631s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07278650-8e47-433b-ba4a-af4c00e6888b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b58829-8205-410d-94cd-405d12db0061]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:41 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b Feb 24 11:05:41 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:42 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b" returned: 0 in 0.549s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:42 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf Feb 24 11:05:42 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:42 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf" returned: 0 in 0.544s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:42 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf Feb 24 11:05:42 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "cinder-5d31b7f9-5733-4a61-97f8-d5268da7f029-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-5d31b7f9-5733-4a61-97f8-d5268da7f029-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "cinder-quobyte-5d31b7f9-5733-4a61-97f8-d5268da7f029" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-quobyte-5d31b7f9-5733-4a61-97f8-d5268da7f029" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f999b08-cb44-4231-9fc6-86f0cffdbfdc]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:43 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 Feb 24 11:05:43 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:43 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b.d20ba3f5-9b95-4e40-a897-3ffad8a4cacf" returned: 0 in 0.510s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-d20ba3f5-9b95-4e40-a897-3ffad8a4cacf" released by "_delete_snapshot" :: held 2.304s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-07278650-8e47-433b-ba4a-af4c00e6888b" released by "delete_snapshot" :: held 2.343s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Created reservations ['b2a07314-fef2-4d64-97eb-2361396eb4f4', 'a0ca58c7-6c68-46e3-939d-2c3397ca02ee', '3ab8f62a-4560-43f7-b65b-8bae08c77f72', '2148d9f5-8df0-4a73-9ce3-c25719ee7934'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:43 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Delete snapshot completed successfully. Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-39f37a17-aecc-4b10-8b9d-6779221a44b2 tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-d20ba3f5-9b95-4e40-a897-3ffad8a4cacf-delete_snapshot" released by "delete_snapshot" :: held 2.466s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:43 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029" returned: 0 in 0.510s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:43 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029 Feb 24 11:05:43 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:44 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-5d31b7f9-5733-4a61-97f8-d5268da7f029" returned: 0 in 0.508s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-quobyte-5d31b7f9-5733-4a61-97f8-d5268da7f029" released by "delete_volume" :: held 1.043s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Created reservations ['77260a11-a18b-436e-959d-858414846cef', '1a94cb24-92c2-4792-9025-f2d521b51243', '686a5163-7b08-4cc7-ad0b-d1bc81ec7e21', '60fcb14c-cbff-4d4e-a138-490f6bace516'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-07278650-8e47-433b-ba4a-af4c00e6888b-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-07278650-8e47-433b-ba4a-af4c00e6888b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "cinder-quobyte-07278650-8e47-433b-ba4a-af4c00e6888b" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-07278650-8e47-433b-ba4a-af4c00e6888b" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff5f5c-12ad-4640-91f1-546e82b22e0c]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:44 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:44 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:44 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b Feb 24 11:05:44 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:44 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b" returned: 0 in 0.500s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:44 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b Feb 24 11:05:44 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:44 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.588s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:44 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Deleted volume successfully. Feb 24 11:05:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ec88b002-363a-4ef3-9add-354940047339 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-5d31b7f9-5733-4a61-97f8-d5268da7f029-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "cinder-39a08cd6-6762-4697-88a2-f6252bcb0e86-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-39a08cd6-6762-4697-88a2-f6252bcb0e86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "cinder-quobyte-39a08cd6-6762-4697-88a2-f6252bcb0e86" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-quobyte-39a08cd6-6762-4697-88a2-f6252bcb0e86" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3873a60b-e56b-4673-a719-e963680e9480]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:45 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-07278650-8e47-433b-ba4a-af4c00e6888b" returned: 0 in 0.585s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-quobyte-07278650-8e47-433b-ba4a-af4c00e6888b" released by "delete_volume" :: held 1.129s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Created reservations ['d8f5a289-0b7e-443a-9c05-f502b95553d5', '7932fd5c-852f-4492-b38f-96eb97f86a2c', '8680fdab-9fe4-44f6-a0c7-36de20cebab7', '5421f3a8-853c-456d-bfb2-f3c90292fac4'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:45 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 Feb 24 11:05:45 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:45 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:45 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:46 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86" returned: 0 in 0.706s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:46 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.552s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:46 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86 Feb 24 11:05:46 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Deleted volume successfully. Feb 24 11:05:46 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e15765fc-dee4-4691-bad6-1cf7a0bbc73d tempest-CreateVolumesFromSnapshotTest-683345538 None] Lock "cinder-07278650-8e47-433b-ba4a-af4c00e6888b-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:46 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-39a08cd6-6762-4697-88a2-f6252bcb0e86" returned: 0 in 0.608s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-quobyte-39a08cd6-6762-4697-88a2-f6252bcb0e86" released by "delete_volume" :: held 1.341s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Created reservations ['0c95c13a-a802-4acf-8bea-5df86ec974e7', '64dc8f8e-2380-46c1-a135-8a1af687a122', '5f653e94-9637-4d60-bd93-9efb13d18a41', '24f89aa0-9bea-4c0a-9a06-80efd6754a53'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:46 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:46 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:47 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.624s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:47 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Deleted volume successfully. Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07f113c1-65dc-4bc6-bdba-44cb88eea0a5 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-39a08cd6-6762-4697-88a2-f6252bcb0e86-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "cinder-4c9b13ef-ccd6-4e00-a738-1225dbb25769-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-4c9b13ef-ccd6-4e00-a738-1225dbb25769-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "cinder-quobyte-4c9b13ef-ccd6-4e00-a738-1225dbb25769" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-quobyte-4c9b13ef-ccd6-4e00-a738-1225dbb25769" acquired by "delete_volume" :: waited 0.018s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[08759ba4-0273-4e5b-9282-3b82a12ba098]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:47 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 Feb 24 11:05:47 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:48 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769" returned: 0 in 0.738s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:48 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769 Feb 24 11:05:48 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Flow 'volume_create_manager' (2431326d-b84c-453d-9a3d-6e99c69268c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc59bbca-43ae-47f7-9938-fd96364b5f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc59bbca-43ae-47f7-9938-fd96364b5f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5f847c-7176-4f25-9348-785a39ff27ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1af226e214ca7a77156d8f71911b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:49Z,use_quota=True,user_id='b4e9762374e842a29879f906ad24c39e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6fe981-416d-40a1-b70d-75f757453269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6fe981-416d-40a1-b70d-75f757453269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a22795-ceac-4af2-a158-947873464bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a22795-ceac-4af2-a158-947873464bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5f847c-7176-4f25-9348-785a39ff27ea', 'volume_name': 'volume-cf5f847c-7176-4f25-9348-785a39ff27ea', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4faf18-d08c-4431-8d29-4e67273a153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4faf18-d08c-4431-8d29-4e67273a153c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fe7be1-b87f-4ccd-a220-758691b24fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:48 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Volume cf5f847c-7176-4f25-9348-785a39ff27ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5f847c-7176-4f25-9348-785a39ff27ea', 'volume_size': 1} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5f847c-7176-4f25-9348-785a39ff27ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1af226e214ca7a77156d8f71911b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:49Z,use_quota=True,user_id='b4e9762374e842a29879f906ad24c39e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Creating volume cf5f847c-7176-4f25-9348-785a39ff27ea {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:48 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:48 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea 1073741824 Feb 24 11:05:48 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:48 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-4c9b13ef-ccd6-4e00-a738-1225dbb25769" returned: 0 in 0.567s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-quobyte-4c9b13ef-ccd6-4e00-a738-1225dbb25769" released by "delete_volume" :: held 1.347s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Created reservations ['2c8ad1cc-c069-4409-b8ae-1ce7098b991c', '355e9a5e-e9fb-411c-b0f0-0f5def762187', '9d0d780e-b0ab-4f77-81ba-87e21d01dc2d', '03882d6c-2db8-4fdb-b8d7-a350bac1187f'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:49 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:05:49 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:49 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea 1073741824" returned: 0 in 0.634s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:49 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea Feb 24 11:05:49 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:49 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.632s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:05:49 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Deleted volume successfully. Feb 24 11:05:49 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3e8c4d5f-ee90-467f-8263-eadc9b24a9e1 tempest-VolumesListTestJSON-1651339302 None] Lock "cinder-4c9b13ef-ccd6-4e00-a738-1225dbb25769-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:05:50 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea" returned: 0 in 0.478s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fe7be1-b87f-4ccd-a220-758691b24fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5f847c-7176-4f25-9348-785a39ff27ea', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb7a25d-7950-4a22-ad53-2c1834741b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:50 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Volume volume-cf5f847c-7176-4f25-9348-785a39ff27ea (cf5f847c-7176-4f25-9348-785a39ff27ea): created successfully Feb 24 11:05:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb7a25d-7950-4a22-ad53-2c1834741b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Flow 'volume_create_manager' (2431326d-b84c-453d-9a3d-6e99c69268c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:50 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7e353f4a-710a-455b-be04-e646463d8dfd tempest-CinderUnicodeTest-378061398 None] Created volume successfully. Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Flow 'volume_create_manager' (fa24f3fd-5201-4481-bbfb-a73adf7456cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1533434-4d80-4f34-b603-a5ccc5ee8fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1533434-4d80-4f34-b603-a5ccc5ee8fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1498387096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb86400f-3cd1-4a0d-85ae-eb389f75c669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1af226e214ca7a77156d8f71911b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:51Z,use_quota=True,user_id='b4e9762374e842a29879f906ad24c39e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14f8f26-74f9-4537-9b29-8cf59572fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14f8f26-74f9-4537-9b29-8cf59572fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88554633-32af-4c52-b6c0-b406f179abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88554633-32af-4c52-b6c0-b406f179abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb86400f-3cd1-4a0d-85ae-eb389f75c669', 'volume_name': 'volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928efcbc-eae9-4752-952a-97cfe2989394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928efcbc-eae9-4752-952a-97cfe2989394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a55848e-c80e-41fe-9c3b-b0f9effca883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:51 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Volume cb86400f-3cd1-4a0d-85ae-eb389f75c669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669', 'volume_size': 1} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1498387096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb86400f-3cd1-4a0d-85ae-eb389f75c669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1af226e214ca7a77156d8f71911b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:51Z,use_quota=True,user_id='b4e9762374e842a29879f906ad24c39e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Creating volume cb86400f-3cd1-4a0d-85ae-eb389f75c669 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:51 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:51 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 1073741824 Feb 24 11:05:51 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:52 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 1073741824" returned: 0 in 0.641s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:52 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 Feb 24 11:05:52 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Flow 'volume_create_manager' (9146a76d-77df-4fb0-97bb-88f9115c8526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca123d6-4fca-468f-9836-bb91ad5a3173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca123d6-4fca-468f-9836-bb91ad5a3173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-298529546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98247834-102d-4ecf-b044-db6f245b4064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2e2005bda24cc29f449bfc67220cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:52Z,use_quota=True,user_id='7141785ec3354c5894a9c30fbcb1b405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eee4aa-e7e4-4260-a247-20da5e58c4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eee4aa-e7e4-4260-a247-20da5e58c4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9292db2-06a3-4f83-83b3-04be98a18fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9292db2-06a3-4f83-83b3-04be98a18fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98247834-102d-4ecf-b044-db6f245b4064', 'volume_name': 'volume-98247834-102d-4ecf-b044-db6f245b4064', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae8dd42-63b8-4fca-98e3-11db2f99ebb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae8dd42-63b8-4fca-98e3-11db2f99ebb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c60d4ec-e32d-4fd3-bf1e-7294f24dad2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:52 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Volume 98247834-102d-4ecf-b044-db6f245b4064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98247834-102d-4ecf-b044-db6f245b4064', 'volume_size': 1} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:52 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669" returned: 0 in 0.458s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-298529546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98247834-102d-4ecf-b044-db6f245b4064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2e2005bda24cc29f449bfc67220cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:05:52Z,use_quota=True,user_id='7141785ec3354c5894a9c30fbcb1b405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Creating volume 98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:05:52 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a55848e-c80e-41fe-9c3b-b0f9effca883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833859e9-67d6-422c-a17d-37b666f02dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:52 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 1073741824 Feb 24 11:05:52 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:52 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Volume volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 (cb86400f-3cd1-4a0d-85ae-eb389f75c669): created successfully Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833859e9-67d6-422c-a17d-37b666f02dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Flow 'volume_create_manager' (fa24f3fd-5201-4481-bbfb-a73adf7456cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:52 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f86dc57c-ad94-40de-90c4-75043c5d8cbf tempest-CinderUnicodeTest-378061398 None] Created volume successfully. Feb 24 11:05:53 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 1073741824" returned: 0 in 0.653s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:53 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 Feb 24 11:05:53 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:53 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064" returned: 0 in 0.649s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.225s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Creating offline snapshot 66488d55-5849-495d-9977-a7d3919d0e70 of volume cb86400f-3cd1-4a0d-85ae-eb389f75c669 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c60d4ec-e32d-4fd3-bf1e-7294f24dad2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98247834-102d-4ecf-b044-db6f245b4064', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f1eb4f-3a03-44e3-b64b-56665af2e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:05:53 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee790c11-d7f8-47dc-aab7-7f368d5c785b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:54 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Volume volume-98247834-102d-4ecf-b044-db6f245b4064 (98247834-102d-4ecf-b044-db6f245b4064): created successfully Feb 24 11:05:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f1eb4f-3a03-44e3-b64b-56665af2e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:05:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Flow 'volume_create_manager' (9146a76d-77df-4fb0-97bb-88f9115c8526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:05:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-487d6293-fa7c-4c4e-86e5-085a74011573 tempest-VolumeDependencyTests-1196198718 None] Created volume successfully. Feb 24 11:05:54 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 Feb 24 11:05:54 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:54 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669" returned: 0 in 0.574s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:54 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 1G Feb 24 11:05:54 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:05:55 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 1G" returned: 0 in 0.683s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:55 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 Feb 24 11:05:55 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:55 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:55 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 is being set with open permissions: ugo+rw Feb 24 11:05:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:55 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 Feb 24 11:05:55 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:56 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70" returned: 0 in 0.434s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:56 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.info Feb 24 11:05:56 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:56 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.info" returned: 0 in 0.452s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:56 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.info is being set with open permissions: ugo+rw Feb 24 11:05:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:56 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.info Feb 24 11:05:56 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:57 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.info" returned: 0 in 0.453s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.162s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.481s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Creating offline snapshot 82c81a7f-3f2f-4861-92e9-a7efbe414020 of volume 98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:05:57 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-deca778a-de3f-4a63-a9e3-fbc28f0e8061 tempest-CinderUnicodeTest-378061398 None] Create snapshot completed successfully Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa0d8a8-c0fc-49bc-9ec2-a5df91e58867]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:57 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 Feb 24 11:05:57 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:57 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064" returned: 0 in 0.550s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:57 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 1G Feb 24 11:05:57 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "cinder-66488d55-5849-495d-9977-a7d3919d0e70-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-66488d55-5849-495d-9977-a7d3919d0e70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "cinder-quobyte-cb86400f-3cd1-4a0d-85ae-eb389f75c669" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-quobyte-cb86400f-3cd1-4a0d-85ae-eb389f75c669" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "cinder-quobyte-66488d55-5849-495d-9977-a7d3919d0e70" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-quobyte-66488d55-5849-495d-9977-a7d3919d0e70" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Deleting offline snapshot 66488d55-5849-495d-9977-a7d3919d0e70 of volume cb86400f-3cd1-4a0d-85ae-eb389f75c669 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] snapshot_file for this snap is: volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f0d1ec-38ed-4894-ac7c-ea060724cd74]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:58 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 Feb 24 11:05:58 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:58 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 1G" returned: 0 in 0.674s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98247834-102d-4ecf-b044-db6f245b4064 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:58 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98247834-102d-4ecf-b044-db6f245b4064 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 Feb 24 11:05:58 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:58 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70" returned: 0 in 0.583s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:05:58 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3317b745-76d8-439f-8502-5a2272eb3dd4]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:05:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:58 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 Feb 24 11:05:58 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:58 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98247834-102d-4ecf-b044-db6f245b4064 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020" returned: 0 in 0.455s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:58 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 is being set with open permissions: ugo+rw Feb 24 11:05:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:58 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 Feb 24 11:05:58 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:59 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669" returned: 0 in 0.510s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:59 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 Feb 24 11:05:59 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:59 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020" returned: 0 in 0.408s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:59 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.info Feb 24 11:05:59 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:59 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70" returned: 0 in 0.524s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:59 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70 Feb 24 11:05:59 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:05:59 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Feb 24 11:05:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.info" returned: 0 in 0.426s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:05:59 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.info is being set with open permissions: ugo+rw Feb 24 11:05:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:05:59 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.info Feb 24 11:05:59 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:00 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669.66488d55-5849-495d-9977-a7d3919d0e70" returned: 0 in 0.486s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-quobyte-66488d55-5849-495d-9977-a7d3919d0e70" released by "_delete_snapshot" :: held 2.157s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-quobyte-cb86400f-3cd1-4a0d-85ae-eb389f75c669" released by "delete_snapshot" :: held 2.176s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:00 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Created reservations ['ea208b93-a992-4edb-a322-4b4cfd554b10', 'e6f45ce1-3700-462b-af1f-b3cb1db294cb', '5bc9d1dd-421b-4f3d-9852-2ec0c2054f58', 'e7e39e2e-2c6e-412f-a0aa-f29043606fcd'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:00 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.info" returned: 0 in 0.478s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.070s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Delete snapshot completed successfully. Feb 24 11:06:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-05768268-275b-4841-9434-2e1c27f56b26 tempest-VolumeDependencyTests-1196198718 None] Create snapshot completed successfully Feb 24 11:06:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89af42ac-1547-4da9-b64d-9c8b00889881 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-66488d55-5849-495d-9977-a7d3919d0e70-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "cinder-cb86400f-3cd1-4a0d-85ae-eb389f75c669-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-cb86400f-3cd1-4a0d-85ae-eb389f75c669-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "cinder-quobyte-cb86400f-3cd1-4a0d-85ae-eb389f75c669" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Flow 'volume_create_manager' (9d776b47-e187-4ebf-8276-67e5e9089e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81232f2c-4e1d-4ba6-94de-2611e60ed51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-quobyte-cb86400f-3cd1-4a0d-85ae-eb389f75c669" acquired by "delete_volume" :: waited 0.032s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81232f2c-4e1d-4ba6-94de-2611e60ed51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1324978376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aedbc111-8327-4b31-8e19-d215be8dfa77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2e2005bda24cc29f449bfc67220cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82c81a7f-3f2f-4861-92e9-a7efbe414020,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:01Z,use_quota=True,user_id='7141785ec3354c5894a9c30fbcb1b405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3043af6-bfab-4021-95d9-12f161373ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3043af6-bfab-4021-95d9-12f161373ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd584fb-5e14-42ec-a1ff-e74407cace57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd584fb-5e14-42ec-a1ff-e74407cace57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aedbc111-8327-4b31-8e19-d215be8dfa77', 'volume_name': 'volume-aedbc111-8327-4b31-8e19-d215be8dfa77', 'volume_size': 1, 'snapshot_id': '82c81a7f-3f2f-4861-92e9-a7efbe414020'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edd7cde-ba71-4c13-a2c1-38703e61b54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edd7cde-ba71-4c13-a2c1-38703e61b54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094e5b84-3583-4fb1-81d7-45e2d1789217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:01 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Volume aedbc111-8327-4b31-8e19-d215be8dfa77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aedbc111-8327-4b31-8e19-d215be8dfa77', 'volume_size': 1, 'snapshot_id': '82c81a7f-3f2f-4861-92e9-a7efbe414020'} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ef4f1-b4bf-4541-be33-202afebb2b95]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-82c81a7f-3f2f-4861-92e9-a7efbe414020-aedbc111-8327-4b31-8e19-d215be8dfa77" by "_create_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-82c81a7f-3f2f-4861-92e9-a7efbe414020-aedbc111-8327-4b31-8e19-d215be8dfa77" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Creating volume aedbc111-8327-4b31-8e19-d215be8dfa77 from snapshot 82c81a7f-3f2f-4861-92e9-a7efbe414020 {{(pid=82627) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-aedbc111-8327-4b31-8e19-d215be8dfa77" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-aedbc111-8327-4b31-8e19-d215be8dfa77" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] snapshot: 82c81a7f-3f2f-4861-92e9-a7efbe414020, volume: aedbc111-8327-4b31-8e19-d215be8dfa77, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12e04f-137e-403f-ae78-bdba89d7889e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:01 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 Feb 24 11:06:01 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:01 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 Feb 24 11:06:01 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:01 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669" returned: 0 in 0.532s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:01 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669 Feb 24 11:06:01 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:01 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020" returned: 0 in 0.508s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98247834-102d-4ecf-b044-db6f245b4064(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b4efc5-2f6a-4438-807e-fbd85cf57d84]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:01 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 Feb 24 11:06:01 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:02 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cb86400f-3cd1-4a0d-85ae-eb389f75c669" returned: 0 in 0.466s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-quobyte-cb86400f-3cd1-4a0d-85ae-eb389f75c669" released by "delete_volume" :: held 1.066s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Created reservations ['67e6daeb-47aa-476b-a6b0-3c7691317ec0', '666dfbe3-fe03-4386-9b14-1cf1cf2183fc', '9b511dc3-0195-4901-8149-9588dba9c2a6', '06ecbda1-b46c-48f9-b616-e9875feac36b'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:02 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064" returned: 0 in 0.516s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:02 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:02 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:02 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 Feb 24 11:06:02 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:02 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.533s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:02 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Deleted volume successfully. Feb 24 11:06:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2d2ca4b4-309e-4531-95e8-4d5af31c1375 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-cb86400f-3cd1-4a0d-85ae-eb389f75c669-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "cinder-cf5f847c-7176-4f25-9348-785a39ff27ea-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-cf5f847c-7176-4f25-9348-785a39ff27ea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "cinder-quobyte-cf5f847c-7176-4f25-9348-785a39ff27ea" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-quobyte-cf5f847c-7176-4f25-9348-785a39ff27ea" acquired by "delete_volume" :: waited 0.018s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:03 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4962c99-3e38-4e77-a131-cf1555ab856b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:04 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea Feb 24 11:06:04 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:05 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea" returned: 0 in 1.804s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:05 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea Feb 24 11:06:05 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:05 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77" returned: 0 in 3.097s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:05 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f18d59e-39d3-4e6a-bc45-ff7fc391df5a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:05 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 Feb 24 11:06:05 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:06 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cf5f847c-7176-4f25-9348-785a39ff27ea" returned: 0 in 0.577s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-quobyte-cf5f847c-7176-4f25-9348-785a39ff27ea" released by "delete_volume" :: held 2.430s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Created reservations ['263a3ba3-7f63-49ef-9f80-3428eae4e90f', 'da9e132f-8fb3-42db-bb88-94df5fa6ee79', 'bdb9ad69-f188-41ae-89e0-d858ddf185cf', '3e16b003-55df-45f4-a11b-ec385f1012b2'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:06 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:06 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:06 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064" returned: 0 in 0.955s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064, size 1024.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:06:06 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Converted 1024.00 MB image at 330.44 MB/s Feb 24 11:06:06 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 is being set with open permissions: ugo+rw Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:06 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 Feb 24 11:06:06 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:06 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.535s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:06 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Deleted volume successfully. Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-53fa267b-49b6-44de-ade1-cfe0c29911f0 tempest-CinderUnicodeTest-378061398 None] Lock "cinder-cf5f847c-7176-4f25-9348-785a39ff27ea-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:06 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77" returned: 0 in 0.502s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-aedbc111-8327-4b31-8e19-d215be8dfa77" released by "_copy_volume_from_snapshot" :: held 5.637s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-82c81a7f-3f2f-4861-92e9-a7efbe414020-aedbc111-8327-4b31-8e19-d215be8dfa77" released by "_create_volume_from_snapshot" :: held 5.655s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.665s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094e5b84-3583-4fb1-81d7-45e2d1789217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aedbc111-8327-4b31-8e19-d215be8dfa77', 'volume_size': 1, 'snapshot_id': '82c81a7f-3f2f-4861-92e9-a7efbe414020'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3551574f-cf49-475d-850e-e54c13657477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:07 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Volume volume-aedbc111-8327-4b31-8e19-d215be8dfa77 (aedbc111-8327-4b31-8e19-d215be8dfa77): created successfully Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3551574f-cf49-475d-850e-e54c13657477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Flow 'volume_create_manager' (9d776b47-e187-4ebf-8276-67e5e9089e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:07 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8e905528-eed9-4237-9c34-8ee2a1d2b862 tempest-VolumeDependencyTests-1196198718 None] Created volume successfully. Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-82c81a7f-3f2f-4861-92e9-a7efbe414020-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-82c81a7f-3f2f-4861-92e9-a7efbe414020-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-98247834-102d-4ecf-b044-db6f245b4064" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-98247834-102d-4ecf-b044-db6f245b4064" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-82c81a7f-3f2f-4861-92e9-a7efbe414020" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-82c81a7f-3f2f-4861-92e9-a7efbe414020" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Deleting offline snapshot 82c81a7f-3f2f-4861-92e9-a7efbe414020 of volume 98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] snapshot_file for this snap is: volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[09497779-158a-46db-bdbb-44b5be0318d4]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:08 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 Feb 24 11:06:08 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:08 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020" returned: 0 in 0.491s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98247834-102d-4ecf-b044-db6f245b4064(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:06:08 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[25401046-2185-4f0e-bf58-9d6bbb33cd36]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:08 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 Feb 24 11:06:08 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:08 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064" returned: 0 in 0.486s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:08 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 Feb 24 11:06:08 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:09 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:09 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020 Feb 24 11:06:09 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:09 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064.82c81a7f-3f2f-4861-92e9-a7efbe414020" returned: 0 in 0.428s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-82c81a7f-3f2f-4861-92e9-a7efbe414020" released by "_delete_snapshot" :: held 1.946s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-98247834-102d-4ecf-b044-db6f245b4064" released by "delete_snapshot" :: held 1.958s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:09 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Created reservations ['922fdee3-c43b-41df-b7cb-10ca1385625b', 'cfde0046-c0ca-4837-a1b5-6978c28018e6', 'ecf616a0-1150-4f1c-8164-bd370ba36e75', '8d77b95a-2bdf-43a7-8b96-8d53e9b29759'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:09 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Delete snapshot completed successfully. Feb 24 11:06:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f4897893-4945-4082-a3ab-798a5420c8d5 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-82c81a7f-3f2f-4861-92e9-a7efbe414020-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-98247834-102d-4ecf-b044-db6f245b4064-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-98247834-102d-4ecf-b044-db6f245b4064-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-98247834-102d-4ecf-b044-db6f245b4064" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-98247834-102d-4ecf-b044-db6f245b4064" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:10 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c1b9f1-3743-466d-80c1-14f5b3eb0f0b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:10 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 Feb 24 11:06:10 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:10 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064" returned: 0 in 0.522s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:10 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064 Feb 24 11:06:10 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:11 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-98247834-102d-4ecf-b044-db6f245b4064" returned: 0 in 0.413s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-98247834-102d-4ecf-b044-db6f245b4064" released by "delete_volume" :: held 0.967s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Created reservations ['1b0bd263-3161-4df9-a984-e02369df5ebf', '247d36cb-79e2-461d-8c52-a08a7014c005', '2758c03e-3c42-4479-be5c-02e4f699a265', 'f0499670-8743-4b3e-b577-1023f143fbe1'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:11 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:11 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Flow 'volume_create_manager' (c2c0dd64-c806-4934-9c0f-c03baa8d4809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c95fa2c-e615-4ec6-9ff5-560266d2b9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c95fa2c-e615-4ec6-9ff5-560266d2b9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1656797408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33964188-37bc-4a7e-a813-243a4110b368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2e2005bda24cc29f449bfc67220cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:12Z,use_quota=True,user_id='7141785ec3354c5894a9c30fbcb1b405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437d9461-1707-457d-9bd5-6af9950d25db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437d9461-1707-457d-9bd5-6af9950d25db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcd9e52-c9ab-4a4e-b723-533879b29fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcd9e52-c9ab-4a4e-b723-533879b29fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33964188-37bc-4a7e-a813-243a4110b368', 'volume_name': 'volume-33964188-37bc-4a7e-a813-243a4110b368', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd64cea3-0d62-4bbb-b51b-0df22c457fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd64cea3-0d62-4bbb-b51b-0df22c457fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d50ef59-7ea2-4ad8-85da-dba027a4a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:11 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Volume 33964188-37bc-4a7e-a813-243a4110b368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33964188-37bc-4a7e-a813-243a4110b368', 'volume_size': 1} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1656797408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33964188-37bc-4a7e-a813-243a4110b368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2e2005bda24cc29f449bfc67220cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:12Z,use_quota=True,user_id='7141785ec3354c5894a9c30fbcb1b405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Creating volume 33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:11 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:11 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 1073741824 Feb 24 11:06:11 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:11 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.736s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Deleted volume successfully. Feb 24 11:06:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d620f723-d94f-47d2-a286-871603162aa1 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-98247834-102d-4ecf-b044-db6f245b4064-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:12 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 1073741824" returned: 0 in 0.579s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:12 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 Feb 24 11:06:12 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:12 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368" returned: 0 in 0.532s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d50ef59-7ea2-4ad8-85da-dba027a4a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33964188-37bc-4a7e-a813-243a4110b368', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482554f1-9a7f-4d70-8db5-a747bf984001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:12 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Volume volume-33964188-37bc-4a7e-a813-243a4110b368 (33964188-37bc-4a7e-a813-243a4110b368): created successfully Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482554f1-9a7f-4d70-8db5-a747bf984001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:12 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Flow 'volume_create_manager' (c2c0dd64-c806-4934-9c0f-c03baa8d4809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:12 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7737161f-8e6c-487c-9499-8027a919c4b6 tempest-VolumeDependencyTests-1196198718 None] Created volume successfully. Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (f967eedf-ced0-41dd-970e-91c67d3dbf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34ed887-7e43-4ba2-a2a3-29ac8e6bf73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34ed887-7e43-4ba2-a2a3-29ac8e6bf73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1430351623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092c3234-4fab-4eba-8d99-8192202dc828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:13Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb3528f-adc7-4f01-9b6f-1a1ea5768191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb3528f-adc7-4f01-9b6f-1a1ea5768191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b38eeb-256a-4b43-acbf-136c6d25d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b38eeb-256a-4b43-acbf-136c6d25d555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092c3234-4fab-4eba-8d99-8192202dc828', 'volume_name': 'volume-092c3234-4fab-4eba-8d99-8192202dc828', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc53da8d-a846-447a-be1a-4a760bf66638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc53da8d-a846-447a-be1a-4a760bf66638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fc797e-b788-4fab-ad35-64216d3c5714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:13 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Volume 092c3234-4fab-4eba-8d99-8192202dc828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092c3234-4fab-4eba-8d99-8192202dc828', 'volume_size': 1} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1430351623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092c3234-4fab-4eba-8d99-8192202dc828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:13Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Creating volume 092c3234-4fab-4eba-8d99-8192202dc828 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:13 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:06:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:13 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 1073741824 Feb 24 11:06:13 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:14 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 1073741824" returned: 0 in 0.675s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:14 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 Feb 24 11:06:14 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Flow 'volume_create_manager' (30e0380d-0ccd-4bdb-a677-9bbb665bc1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63353286-b18d-4b70-9ac7-f57a98122039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63353286-b18d-4b70-9ac7-f57a98122039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-415495368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2e2005bda24cc29f449bfc67220cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=33964188-37bc-4a7e-a813-243a4110b368,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:14Z,use_quota=True,user_id='7141785ec3354c5894a9c30fbcb1b405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7567c72c-0a04-4c73-b421-9456f8bba0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7567c72c-0a04-4c73-b421-9456f8bba0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8680c9b-a660-4177-88ab-f54972751192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8680c9b-a660-4177-88ab-f54972751192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac', 'volume_name': 'volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac', 'volume_size': 1, 'source_volid': '33964188-37bc-4a7e-a813-243a4110b368', 'source_volstatus': 'available'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da7573b-fd73-4d47-b6fc-2b844982dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da7573b-fd73-4d47-b6fc-2b844982dce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c945f50a-0bbc-4482-a320-0d161fb178e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:14 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Volume fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac', 'volume_size': 1, 'source_volid': '33964188-37bc-4a7e-a813-243a4110b368', 'source_volstatus': 'available'} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:14 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828" returned: 0 in 0.419s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.337s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:14 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Cloning volume 33964188-37bc-4a7e-a813-243a4110b368 to volume fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fc797e-b788-4fab-ad35-64216d3c5714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092c3234-4fab-4eba-8d99-8192202dc828', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0fb628-a955-4601-82da-382732a9eb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Creating offline snapshot 8762328e-3a1e-4477-8a0b-0c7832bf875c of volume 33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:06:14 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Volume volume-092c3234-4fab-4eba-8d99-8192202dc828 (092c3234-4fab-4eba-8d99-8192202dc828): created successfully Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0fb628-a955-4601-82da-382732a9eb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (f967eedf-ced0-41dd-970e-91c67d3dbf80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce086003-8d00-4a3d-89cc-c68e0c049da3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:14 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-2b134a1d-3fe4-4512-b649-4e8dd50f933d tempest-VolumesActionsTest-286713450 None] Created volume successfully. Feb 24 11:06:14 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 Feb 24 11:06:14 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:15 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368" returned: 0 in 0.477s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:15 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c 1G Feb 24 11:06:15 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c1301fca-38a6-46c5-89c8-4278e0519dae tempest-VolumesActionsTest-286713450 None] Acquiring lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828" by "attach_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c1301fca-38a6-46c5-89c8-4278e0519dae tempest-VolumesActionsTest-286713450 None] Lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828" acquired by "attach_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c1301fca-38a6-46c5-89c8-4278e0519dae tempest-VolumesActionsTest-286713450 None] Attaching volume 092c3234-4fab-4eba-8d99-8192202dc828 to instance 3484a2c5-6f2e-43e9-930f-706c713ee8a1 at mountpoint /dev/vdb on host None. Feb 24 11:06:15 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c1301fca-38a6-46c5-89c8-4278e0519dae tempest-VolumesActionsTest-286713450 None] Attach volume completed successfully. Feb 24 11:06:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c1301fca-38a6-46c5-89c8-4278e0519dae tempest-VolumesActionsTest-286713450 None] Lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828" released by "attach_volume" :: held 0.072s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:15 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c 1G" returned: 0 in 0.524s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33964188-37bc-4a7e-a813-243a4110b368 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:15 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33964188-37bc-4a7e-a813-243a4110b368 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c Feb 24 11:06:15 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:16 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33964188-37bc-4a7e-a813-243a4110b368 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c" returned: 0 in 0.438s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:16 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c is being set with open permissions: ugo+rw Feb 24 11:06:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:16 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c Feb 24 11:06:16 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:16 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c" returned: 0 in 0.420s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:16 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.info Feb 24 11:06:16 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:16 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3b637b6d-7cf2-4a74-a8c8-37d2b13743ed tempest-VolumesActionsTest-606025679 None] Terminate volume connection completed successfully. Feb 24 11:06:16 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.info" returned: 0 in 0.447s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:16 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.info is being set with open permissions: ugo+rw Feb 24 11:06:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:16 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.info Feb 24 11:06:16 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3b637b6d-7cf2-4a74-a8c8-37d2b13743ed tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-detach_volume" by "detach_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3b637b6d-7cf2-4a74-a8c8-37d2b13743ed tempest-VolumesActionsTest-606025679 None] Lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:17 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3b637b6d-7cf2-4a74-a8c8-37d2b13743ed tempest-VolumesActionsTest-606025679 None] Detaching volume 092c3234-4fab-4eba-8d99-8192202dc828 from instance 3484a2c5-6f2e-43e9-930f-706c713ee8a1. Feb 24 11:06:17 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3b637b6d-7cf2-4a74-a8c8-37d2b13743ed tempest-VolumesActionsTest-606025679 None] Detach volume completed successfully. Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3b637b6d-7cf2-4a74-a8c8-37d2b13743ed tempest-VolumesActionsTest-606025679 None] Lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:17 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.info" returned: 0 in 0.413s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] snapshot: 8762328e-3a1e-4477-8a0b-0c7832bf875c, volume: fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d016a697-492c-429a-935a-1c55b46d2d8b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:17 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c Feb 24 11:06:17 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2ec60a25-7beb-44e3-8c51-16f16daeb45f tempest-VolumesActionsTest-286713450 None] Acquiring lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-detach_volume" by "detach_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:17 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c" returned: 0 in 0.533s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33964188-37bc-4a7e-a813-243a4110b368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2ec60a25-7beb-44e3-8c51-16f16daeb45f tempest-VolumesActionsTest-286713450 None] Lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:17 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-2ec60a25-7beb-44e3-8c51-16f16daeb45f tempest-VolumesActionsTest-286713450 None] Volume detach called, but volume not attached. Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a16614b-5759-4faa-9a6d-6be450ffb916]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2ec60a25-7beb-44e3-8c51-16f16daeb45f tempest-VolumesActionsTest-286713450 None] Lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:18 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 Feb 24 11:06:18 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:18 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368" returned: 0 in 0.545s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:18 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac Feb 24 11:06:18 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Acquiring lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Acquiring lock "cinder-quobyte-092c3234-4fab-4eba-8d99-8192202dc828" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Lock "cinder-quobyte-092c3234-4fab-4eba-8d99-8192202dc828" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[966cb27c-536e-48bd-8eea-14f8b10ca80c]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:18 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 Feb 24 11:06:18 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:19 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828" returned: 0 in 0.643s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:19 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828 Feb 24 11:06:19 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:20 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-092c3234-4fab-4eba-8d99-8192202dc828" returned: 0 in 0.938s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Lock "cinder-quobyte-092c3234-4fab-4eba-8d99-8192202dc828" released by "delete_volume" :: held 1.623s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=156,cinder:UPDATE=207,cinder:DELETE=13,cinder:INSERT=49 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=144,cinder:UPDATE=168,cinder:INSERT=44,cinder:DELETE=19 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Created reservations ['4c57e1df-cab5-4c04-9300-1fdb846f60c9', '9a1edb22-7499-40b9-a449-3db62db04ac1', 'dde13f9e-dd33-4974-9bf8-cf67013f5a85', '75d3cb26-575c-42b4-9a77-88aa868fbe6d'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:20 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:20 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:21 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" returned: 0 in 2.904s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:21 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f31b6-67c1-44f7-b5aa-42ca9872cdb1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:21 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 Feb 24 11:06:21 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:21 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.080s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:21 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Deleted volume successfully. Feb 24 11:06:21 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-16a35a69-fc99-4e97-a3aa-3e50f70df29e tempest-VolumesActionsTest-286713450 None] Lock "cinder-092c3234-4fab-4eba-8d99-8192202dc828-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:22 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368" returned: 0 in 0.663s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368, size 1024.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:06:22 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Converted 1024.00 MB image at 352.46 MB/s Feb 24 11:06:22 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac is being set with open permissions: ugo+rw Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:22 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac Feb 24 11:06:22 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:22 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" returned: 0 in 0.425s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" released by "_copy_volume_from_snapshot" :: held 5.141s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-8762328e-3a1e-4477-8a0b-0c7832bf875c" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-8762328e-3a1e-4477-8a0b-0c7832bf875c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Deleting offline snapshot 8762328e-3a1e-4477-8a0b-0c7832bf875c of volume 33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] snapshot_file for this snap is: volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55df7a1-f2a7-4da1-ad1b-17a34b8ca30a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:22 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c Feb 24 11:06:22 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:23 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c" returned: 0 in 0.531s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33964188-37bc-4a7e-a813-243a4110b368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:06:23 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9bf468-28e5-40bf-a669-a4acb81687e2]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:23 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 Feb 24 11:06:23 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:23 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368" returned: 0 in 0.455s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:23 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c Feb 24 11:06:23 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:24 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c" returned: 0 in 0.461s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:24 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c Feb 24 11:06:24 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:24 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368.8762328e-3a1e-4477-8a0b-0c7832bf875c" returned: 0 in 0.402s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-8762328e-3a1e-4477-8a0b-0c7832bf875c" released by "_delete_snapshot" :: held 1.928s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.925s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c945f50a-0bbc-4482-a320-0d161fb178e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac', 'volume_size': 1, 'source_volid': '33964188-37bc-4a7e-a813-243a4110b368', 'source_volstatus': 'available'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765d799c-1233-431f-93bd-e5560d87fa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:24 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Volume volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac (fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac): created successfully Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765d799c-1233-431f-93bd-e5560d87fa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Flow 'volume_create_manager' (30e0380d-0ccd-4bdb-a677-9bbb665bc1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:24 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ae8680c5-0ee0-47fd-a6b4-45b5d6428660 tempest-VolumeDependencyTests-1196198718 None] Created volume successfully. Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-33964188-37bc-4a7e-a813-243a4110b368-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-33964188-37bc-4a7e-a813-243a4110b368-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-33964188-37bc-4a7e-a813-243a4110b368" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-33964188-37bc-4a7e-a813-243a4110b368" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[811e8711-a930-4b8c-a9e9-75a9525f9e70]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:24 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 Feb 24 11:06:24 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:25 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368" returned: 0 in 0.479s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:25 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368 Feb 24 11:06:25 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:25 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-33964188-37bc-4a7e-a813-243a4110b368" returned: 0 in 0.395s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-33964188-37bc-4a7e-a813-243a4110b368" released by "delete_volume" :: held 0.905s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Created reservations ['3cfeca2b-4399-477e-8d97-92ca32c72577', '6d1db35d-9f06-4add-98dd-54d1c0838215', '65d7e3a8-92f5-45c1-b78a-6e4a444205b6', 'cbb5d846-e1f8-41e2-a0c8-c2a9be049ba4'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:25 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:25 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" acquired by "delete_volume" :: waited 0.006s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5601ef-00cd-49c1-942b-9ba53f84609f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:26 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac Feb 24 11:06:26 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:26 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.432s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:26 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Deleted volume successfully. Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-92f4466d-435d-43b8-878c-e3c7b5d76639 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-33964188-37bc-4a7e-a813-243a4110b368-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:26 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" returned: 0 in 0.499s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:26 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac Feb 24 11:06:26 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:26 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" returned: 0 in 0.416s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac" released by "delete_volume" :: held 0.946s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Created reservations ['aed518d4-0a12-4591-91d0-827a592cbce1', '6d8e6c29-b2b9-4a19-bfc5-ccc8e76bb423', '44c22e66-0d8b-4ee0-83ba-d509f0ce31c6', 'b309d245-ce32-40c3-8812-48e2bbe6f6da'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:27 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:27 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-aedbc111-8327-4b31-8e19-d215be8dfa77-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-aedbc111-8327-4b31-8e19-d215be8dfa77-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "cinder-quobyte-aedbc111-8327-4b31-8e19-d215be8dfa77" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-aedbc111-8327-4b31-8e19-d215be8dfa77" acquired by "delete_volume" :: waited 0.006s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f6a4f1-cd83-4b75-9535-58584dcabf1b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:27 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 Feb 24 11:06:27 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:27 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.471s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Deleted volume successfully. Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-55dec65c-cc8b-48f0-b9f7-2e2241513861 tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-fc9fcffd-aded-4e3a-bbe1-efd8e27f1cac-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (6f8faca0-e310-4c60-9240-996e16c119c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7b0baf-436d-4fca-bd7a-4339b9f9c570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7b0baf-436d-4fca-bd7a-4339b9f9c570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1387019453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a613a0-467d-4129-9364-9ee3de40db0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:27Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95dd113-d4e1-4af7-9589-164acd4727fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95dd113-d4e1-4af7-9589-164acd4727fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4989a033-e3b5-4591-8136-02a0aa96b9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4989a033-e3b5-4591-8136-02a0aa96b9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a613a0-467d-4129-9364-9ee3de40db0f', 'volume_name': 'volume-83a613a0-467d-4129-9364-9ee3de40db0f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0796998b-f3b9-4193-a8ff-c38e87ddd484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0796998b-f3b9-4193-a8ff-c38e87ddd484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc53d798-56da-4804-96b1-1445ed17b1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:27 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Volume 83a613a0-467d-4129-9364-9ee3de40db0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a613a0-467d-4129-9364-9ee3de40db0f', 'volume_size': 1} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1387019453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a613a0-467d-4129-9364-9ee3de40db0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:27Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Creating volume 83a613a0-467d-4129-9364-9ee3de40db0f {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:27 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:27 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f 1073741824 Feb 24 11:06:27 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:27 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77" returned: 0 in 0.565s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:27 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77 Feb 24 11:06:27 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:28 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f 1073741824" returned: 0 in 0.497s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:28 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f Feb 24 11:06:28 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:28 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-aedbc111-8327-4b31-8e19-d215be8dfa77" returned: 0 in 0.426s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-quobyte-aedbc111-8327-4b31-8e19-d215be8dfa77" released by "delete_volume" :: held 1.016s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Created reservations ['b068b249-3e0a-4219-9cba-4ebca8beb095', '8c2bf28f-52a6-4af1-b022-571edbe01d93', '37f9813b-c8b7-414f-870b-8742b0d073b0', '0497aa97-d547-4e5f-9df3-91462fff72d3'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:28 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:28 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:28 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f" returned: 0 in 0.437s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc53d798-56da-4804-96b1-1445ed17b1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a613a0-467d-4129-9364-9ee3de40db0f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f3e622-5bdc-4095-8aa1-7258264cc7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:28 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Volume volume-83a613a0-467d-4129-9364-9ee3de40db0f (83a613a0-467d-4129-9364-9ee3de40db0f): created successfully Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f3e622-5bdc-4095-8aa1-7258264cc7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (6f8faca0-e310-4c60-9240-996e16c119c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8a67ff4b-4cec-422f-867e-727d43f5db4c tempest-VolumesActionsTest-286713450 None] Created volume successfully. Feb 24 11:06:28 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.406s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Deleted volume successfully. Feb 24 11:06:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-2c832ae2-c320-4807-ad11-af50f6fe2edf tempest-VolumeDependencyTests-1196198718 None] Lock "cinder-aedbc111-8327-4b31-8e19-d215be8dfa77-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-83a613a0-467d-4129-9364-9ee3de40db0f-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Lock "cinder-83a613a0-467d-4129-9364-9ee3de40db0f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-quobyte-83a613a0-467d-4129-9364-9ee3de40db0f" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Lock "cinder-quobyte-83a613a0-467d-4129-9364-9ee3de40db0f" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:29 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c1ab8-56ba-4f23-875e-b01428c75554]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:29 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f Feb 24 11:06:29 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:30 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f" returned: 0 in 0.516s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:30 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f Feb 24 11:06:30 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:30 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-83a613a0-467d-4129-9364-9ee3de40db0f" returned: 0 in 0.404s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Lock "cinder-quobyte-83a613a0-467d-4129-9364-9ee3de40db0f" released by "delete_volume" :: held 0.942s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Created reservations ['7950fbaf-9d7a-4fb1-94c7-1fe7a6145c29', '90ee086d-fe6a-4562-97bb-6fcb2347d147', 'd950e6e9-2f09-41cd-90d6-0dc5bbe52136', '024bdaf1-bd04-431c-a9e0-ec9839f6fda6'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:30 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:30 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (ba604a22-c48b-4bde-b59c-f2011187b2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2addac-8487-4523-820b-a1c08c662ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2addac-8487-4523-820b-a1c08c662ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-152113534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1e3779-fec0-49ec-8474-e66e5fd8428a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:31Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c01a9c2-c181-482d-8f02-cb216061cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c01a9c2-c181-482d-8f02-cb216061cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac5e332-6c5f-4c43-84c8-803bc9b70d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac5e332-6c5f-4c43-84c8-803bc9b70d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1e3779-fec0-49ec-8474-e66e5fd8428a', 'volume_name': 'volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a265fb0-7e25-4df9-aabf-ccef02c034f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a265fb0-7e25-4df9-aabf-ccef02c034f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eba36b0-e7b7-4357-8fbe-3e685d0fe4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:31 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Volume 0a1e3779-fec0-49ec-8474-e66e5fd8428a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a', 'volume_size': 1} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-152113534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1e3779-fec0-49ec-8474-e66e5fd8428a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:31Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Creating volume 0a1e3779-fec0-49ec-8474-e66e5fd8428a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:31 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:31 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a 1073741824 Feb 24 11:06:31 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:31 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.451s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:31 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Deleted volume successfully. Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1bdd9e1-e66a-4e6f-bbc6-f8d39101193d tempest-VolumesActionsTest-606025679 None] Lock "cinder-83a613a0-467d-4129-9364-9ee3de40db0f-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:31 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a 1073741824" returned: 0 in 0.465s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:31 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a Feb 24 11:06:31 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:32 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a" returned: 0 in 0.397s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eba36b0-e7b7-4357-8fbe-3e685d0fe4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce80521-a288-4895-b89f-e90ab2051977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:32 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Volume volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a (0a1e3779-fec0-49ec-8474-e66e5fd8428a): created successfully Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce80521-a288-4895-b89f-e90ab2051977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (ba604a22-c48b-4bde-b59c-f2011187b2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:32 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-89ddc9db-5579-4a61-9357-9d6563cab58f tempest-VolumesActionsTest-286713450 None] Created volume successfully. Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-0a1e3779-fec0-49ec-8474-e66e5fd8428a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Lock "cinder-0a1e3779-fec0-49ec-8474-e66e5fd8428a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-quobyte-0a1e3779-fec0-49ec-8474-e66e5fd8428a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Lock "cinder-quobyte-0a1e3779-fec0-49ec-8474-e66e5fd8428a" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[183601e8-1e9f-48ee-82d1-3ef0fd517b71]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:32 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a Feb 24 11:06:32 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:32 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a" returned: 0 in 0.460s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:32 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a Feb 24 11:06:32 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:33 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0a1e3779-fec0-49ec-8474-e66e5fd8428a" returned: 0 in 0.398s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Lock "cinder-quobyte-0a1e3779-fec0-49ec-8474-e66e5fd8428a" released by "delete_volume" :: held 0.883s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Created reservations ['9c4e76c7-08cc-4668-a7a2-bdafa3f975f9', '158b5ac7-0fb3-4607-a1fb-e07c4d9b2509', '964fb75f-6b22-49e4-92c3-f1e129eef3b9', '28447af5-dee1-4b6d-aca2-81a0b1947e53'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:33 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:33 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (5b51ca8d-ab54-41b8-952e-b2c3ec91e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c967d211-8bee-4343-85c7-ad5c2aba03f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:33 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c967d211-8bee-4343-85c7-ad5c2aba03f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-509035725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3591e08-3c45-4d96-8955-b53ab15d475d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:34Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e35ce9c-a5c5-4352-8825-73709791d540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e35ce9c-a5c5-4352-8825-73709791d540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105272a0-dd1a-4c3c-b84d-d29283dbab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105272a0-dd1a-4c3c-b84d-d29283dbab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3591e08-3c45-4d96-8955-b53ab15d475d', 'volume_name': 'volume-b3591e08-3c45-4d96-8955-b53ab15d475d', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e090aeae-ee85-47a0-b800-2cd9d1b1ecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e090aeae-ee85-47a0-b800-2cd9d1b1ecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e93f2cc-cb4d-4e43-9022-79eb50767b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:33 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Volume b3591e08-3c45-4d96-8955-b53ab15d475d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3591e08-3c45-4d96-8955-b53ab15d475d', 'volume_size': 1} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-509035725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3591e08-3c45-4d96-8955-b53ab15d475d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:34Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Creating volume b3591e08-3c45-4d96-8955-b53ab15d475d {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:33 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.478s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Deleted volume successfully. Feb 24 11:06:33 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d 1073741824 Feb 24 11:06:33 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7c3bf8a9-06a7-48da-b10b-19a84aa98f80 tempest-VolumesActionsTest-606025679 None] Lock "cinder-0a1e3779-fec0-49ec-8474-e66e5fd8428a-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:34 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:34 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:34 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d 1073741824" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:34 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d Feb 24 11:06:34 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:34 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.440s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:34 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d" returned: 0 in 0.402s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e93f2cc-cb4d-4e43-9022-79eb50767b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3591e08-3c45-4d96-8955-b53ab15d475d', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a32e27-75a5-486f-aa1c-f87f6fbc7554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:34 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Volume volume-b3591e08-3c45-4d96-8955-b53ab15d475d (b3591e08-3c45-4d96-8955-b53ab15d475d): created successfully Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a32e27-75a5-486f-aa1c-f87f6fbc7554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (5b51ca8d-ab54-41b8-952e-b2c3ec91e70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-adb9f914-5c1c-485d-95e7-cdfd25088e4a tempest-VolumesActionsTest-286713450 None] Created volume successfully. Feb 24 11:06:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-b3591e08-3c45-4d96-8955-b53ab15d475d-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Lock "cinder-b3591e08-3c45-4d96-8955-b53ab15d475d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-quobyte-b3591e08-3c45-4d96-8955-b53ab15d475d" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Lock "cinder-quobyte-b3591e08-3c45-4d96-8955-b53ab15d475d" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df3dce6-60b7-4807-ad6d-b756bccbe61b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:36 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d Feb 24 11:06:36 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:36 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d" returned: 0 in 0.457s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:36 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d Feb 24 11:06:36 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:36 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-b3591e08-3c45-4d96-8955-b53ab15d475d" returned: 0 in 0.420s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Lock "cinder-quobyte-b3591e08-3c45-4d96-8955-b53ab15d475d" released by "delete_volume" :: held 0.903s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Created reservations ['fb13c55a-c1ae-43df-ae9d-200fe3c945d9', '98a754a8-ec54-4fd2-8ad9-31969087edad', 'd7f9fc67-7459-4235-b566-ec33e2904b90', 'ee7f8f03-23cf-43fd-8465-36a8fdf8797c'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:37 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:37 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (793f9705-44a3-4f21-b093-6639dba77e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5752bd7c-6fd0-436d-aaf7-0a23abf90f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5752bd7c-6fd0-436d-aaf7-0a23abf90f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1895229884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0c1383-c142-49e9-845c-5bc0bad6dfa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:37Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:37 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c349a-02ac-4ae5-9c00-eae8b903c754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c349a-02ac-4ae5-9c00-eae8b903c754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ecd60e-448d-4efe-9d11-80d20438e9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ecd60e-448d-4efe-9d11-80d20438e9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0c1383-c142-49e9-845c-5bc0bad6dfa4', 'volume_name': 'volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bf3634-9ec9-46da-b08f-1bd40048a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bf3634-9ec9-46da-b08f-1bd40048a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86ef8b1-9cc8-4f5a-8486-b56809d3ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:37 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Volume ff0c1383-c142-49e9-845c-5bc0bad6dfa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4', 'volume_size': 1} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1895229884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0c1383-c142-49e9-845c-5bc0bad6dfa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:37Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Creating volume ff0c1383-c142-49e9-845c-5bc0bad6dfa4 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:37 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.466s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:37 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 1073741824 Feb 24 11:06:37 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:37 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Deleted volume successfully. Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5b745f93-1ec4-41d6-8b85-9253e2e735b5 tempest-VolumesActionsTest-606025679 None] Lock "cinder-b3591e08-3c45-4d96-8955-b53ab15d475d-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:37 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 1073741824" returned: 0 in 0.470s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:37 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 Feb 24 11:06:37 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:38 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4" returned: 0 in 0.471s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:06:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86ef8b1-9cc8-4f5a-8486-b56809d3ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097d40e3-dab6-4251-8985-2861c3ad67a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:38 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Volume volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 (ff0c1383-c142-49e9-845c-5bc0bad6dfa4): created successfully Feb 24 11:06:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097d40e3-dab6-4251-8985-2861c3ad67a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (793f9705-44a3-4f21-b093-6639dba77e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:38 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-da8e3937-1da3-488e-8bad-23f68b067f71 tempest-VolumesActionsTest-286713450 None] Created volume successfully. Feb 24 11:06:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-ff0c1383-c142-49e9-845c-5bc0bad6dfa4-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Lock "cinder-ff0c1383-c142-49e9-845c-5bc0bad6dfa4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Acquiring lock "cinder-quobyte-ff0c1383-c142-49e9-845c-5bc0bad6dfa4" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:39 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Lock "cinder-quobyte-ff0c1383-c142-49e9-845c-5bc0bad6dfa4" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:39 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5c4e6-aa12-4e3f-a3a9-6fa8e960e847]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:39 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 Feb 24 11:06:39 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:40 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4" returned: 0 in 0.457s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:40 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4 Feb 24 11:06:40 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:40 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-ff0c1383-c142-49e9-845c-5bc0bad6dfa4" returned: 0 in 0.401s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Lock "cinder-quobyte-ff0c1383-c142-49e9-845c-5bc0bad6dfa4" released by "delete_volume" :: held 0.887s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Created reservations ['c0711e27-6476-4b8c-b96e-300bf9f02e85', 'c8c50cb8-9a1f-4847-9005-0fb4c9868fd7', '7ec4a7ed-edeb-4d02-bbeb-2f881aeab4ed', 'ba30a51c-bc97-41df-9eb7-021b5ceb8b3a'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:40 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:40 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:40 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (21a769d0-90ff-4cd2-89d7-0a604d52bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca82a08-282a-4be9-a075-f405c1426a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:41 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca82a08-282a-4be9-a075-f405c1426a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-601453233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f2e28e-f66c-47fa-9775-0e5a6cc2d75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:41Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48da698d-b4c4-406c-96e2-c40220678c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48da698d-b4c4-406c-96e2-c40220678c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25222e9-4b88-4744-a3f0-72584d8912e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25222e9-4b88-4744-a3f0-72584d8912e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f2e28e-f66c-47fa-9775-0e5a6cc2d75f', 'volume_name': 'volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78a9801-e692-4fc7-8957-6e84b7c2da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78a9801-e692-4fc7-8957-6e84b7c2da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6fafe8-f937-48c2-850e-40182abf9413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:41 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Volume 06f2e28e-f66c-47fa-9775-0e5a6cc2d75f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f', 'volume_size': 1} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-601453233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f2e28e-f66c-47fa-9775-0e5a6cc2d75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4759af8fc4401dace8b6eadb1609b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:41Z,use_quota=True,user_id='c6923dd107734e5b9a4f393548bd78be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Creating volume 06f2e28e-f66c-47fa-9775-0e5a6cc2d75f {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:41 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.473s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:41 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Deleted volume successfully. Feb 24 11:06:41 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f 1073741824 Feb 24 11:06:41 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-76fabfd6-445d-4713-9044-2415b8dc0355 tempest-VolumesActionsTest-606025679 None] Lock "cinder-ff0c1383-c142-49e9-845c-5bc0bad6dfa4-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:41 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f 1073741824" returned: 0 in 0.469s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:41 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f Feb 24 11:06:41 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:41 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f" returned: 0 in 0.390s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6fafe8-f937-48c2-850e-40182abf9413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe9ddc3-ba98-4c55-b5ea-7c0ee999b738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:41 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Volume volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f (06f2e28e-f66c-47fa-9775-0e5a6cc2d75f): created successfully Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe9ddc3-ba98-4c55-b5ea-7c0ee999b738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:41 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Flow 'volume_create_manager' (21a769d0-90ff-4cd2-89d7-0a604d52bdad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:41 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d347277a-70d9-4a89-bca1-af4196168f37 tempest-VolumesActionsTest-286713450 None] Created volume successfully. Feb 24 11:06:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Acquiring lock "cinder-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Lock "cinder-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Acquiring lock "cinder-quobyte-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:06:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Lock "cinder-quobyte-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:06:42 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8276cd-e9b7-4426-8905-4ae48a511f37]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:42 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f Feb 24 11:06:42 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:43 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f" returned: 0 in 0.527s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:43 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f Feb 24 11:06:43 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:43 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f" returned: 0 in 0.433s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Lock "cinder-quobyte-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f" released by "delete_volume" :: held 0.992s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Created reservations ['96070779-818c-4fbd-bf66-6ab36aa7bd98', 'fbcbf682-0af0-4235-91c4-2e765cd05a21', '888351c9-e5a8-4b60-984a-1dfd513bf01c', 'fd9e74db-6c3d-46cf-af8d-e0268ccdd7e7'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:43 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:06:43 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:44 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.419s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:44 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:06:44 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Deleted volume successfully. Feb 24 11:06:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-e538140f-8753-47e2-9959-d11b6bb53483 tempest-VolumesActionsTest-286713450 None] Lock "cinder-06f2e28e-f66c-47fa-9775-0e5a6cc2d75f-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Flow 'volume_create_manager' (1b1f81d7-3829-4280-9df2-2795de2a05f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890d8cae-f2c8-4df3-af8b-8bcfa61015ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890d8cae-f2c8-4df3-af8b-8bcfa61015ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-706439907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d22d217-f099-4ee7-97ab-42ab56172629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca29ed378dd4a5c8f031eb5287588db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:52Z,use_quota=True,user_id='332b49757cd34c6582cfdc23f9fd898a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7f12b3-ca2c-4c11-bbcf-31a84c967dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7f12b3-ca2c-4c11-bbcf-31a84c967dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e6dd2a-7847-4749-93e6-e8e5fb63508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.image.glance [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Creating Keystone auth plugin from conf {{(pid=82627) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e6dd2a-7847-4749-93e6-e8e5fb63508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d22d217-f099-4ee7-97ab-42ab56172629', 'volume_name': 'volume-3d22d217-f099-4ee7-97ab-42ab56172629', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e838e5-4cd9-41ee-b768-b37cbfa5f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e838e5-4cd9-41ee-b768-b37cbfa5f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e98f7bc-450b-4c2a-9015-28cb24bb41aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:52 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Volume 3d22d217-f099-4ee7-97ab-42ab56172629: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d22d217-f099-4ee7-97ab-42ab56172629', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Trying to clone 3d22d217-f099-4ee7-97ab-42ab56172629 from image 4158f967-877e-452e-b5d3-debeeb743c37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]). {{(pid=82627) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 24 11:06:52 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Image download 20.69 MB at 20.69 MB/s Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b610cd4-907d-47d0-b7ed-6b289c6d05f1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:52 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD Feb 24 11:06:52 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:53 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 is fetched for user 332b49757cd34c6582cfdc23f9fd898a. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1d96e4-f036-4aad-b7bb-73dcee6c0160]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:53 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD Feb 24 11:06:53 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:53 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-706439907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d22d217-f099-4ee7-97ab-42ab56172629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca29ed378dd4a5c8f031eb5287588db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:06:52Z,use_quota=True,user_id='332b49757cd34c6582cfdc23f9fd898a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Creating volume 3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:06:53 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:06:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:53 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 1073741824 Feb 24 11:06:53 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:54 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 1073741824" returned: 0 in 0.518s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:54 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 Feb 24 11:06:54 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:54 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629" returned: 0 in 0.428s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:06:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:06:54 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Attempting download of 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume 3d22d217-f099-4ee7-97ab-42ab56172629. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 24 11:06:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d73d63-7ed8-4592-9336-29b2a4b9e0ba]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_o2ogjx60 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:54 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_o2ogjx60 Feb 24 11:06:54 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:55 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_o2ogjx60" returned: 0 in 0.483s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_o2ogjx60 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:55 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_o2ogjx60 Feb 24 11:06:55 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:55 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_o2ogjx60" returned: 1 in 0.472s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4158f967-877e-452e-b5d3-debeeb743c37_o2ogjx60' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:06:55 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0454f3f8-347c-4d0e-86ac-3e7293b28794]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:55 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD Feb 24 11:06:55 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:56 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:56 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] 4158f967-877e-452e-b5d3-debeeb743c37 was qcow2, converting to raw {{(pid=82627) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 24 11:06:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:56 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 Feb 24 11:06:56 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:57 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629" returned: 0 in 0.890s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:57 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4158f967-877e-452e-b5d3-debeeb743c37_l1jz86bgdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:06:57 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Converted 112.00 MB image at 112.00 MB/s Feb 24 11:06:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:57 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 1G Feb 24 11:06:57 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:57 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 1G" returned: 0 in 0.451s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc07b0d6-b512-42ec-aec5-5eb0c49895f9]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:06:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:57 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 Feb 24 11:06:57 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:58 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629" returned: 0 in 0.473s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:06:58 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 Feb 24 11:06:58 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:06:58 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629" returned: 1 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Downloaded image 4158f967-877e-452e-b5d3-debeeb743c37 ((None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}])) to volume 3d22d217-f099-4ee7-97ab-42ab56172629 successfully. {{(pid=82627) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Temporary image 4158f967-877e-452e-b5d3-debeeb743c37 for user 332b49757cd34c6582cfdc23f9fd898a is deleted. {{(pid=82627) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.volume.volume_utils [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Marking volume 3d22d217-f099-4ee7-97ab-42ab56172629 as bootable. {{(pid=82627) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Copying metadata from image 4158f967-877e-452e-b5d3-debeeb743c37 to 3d22d217-f099-4ee7-97ab-42ab56172629. {{(pid=82627) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Creating volume glance metadata for volume 3d22d217-f099-4ee7-97ab-42ab56172629 backed by image 4158f967-877e-452e-b5d3-debeeb743c37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82627) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e98f7bc-450b-4c2a-9015-28cb24bb41aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d22d217-f099-4ee7-97ab-42ab56172629', 'volume_size': 1, 'image_id': '4158f967-877e-452e-b5d3-debeeb743c37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4158f967-877e-452e-b5d3-debeeb743c37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bb287d054874503b2fd7c80bd16356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4158f967-877e-452e-b5d3-debeeb743c37', 'created_at': datetime.datetime(2026, 2, 24, 9, 54, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 24, 9, 54, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4158f967-877e-452e-b5d3-debeeb743c37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e104e88d-17dc-4cd1-be14-68f3398b42b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:06:58 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Volume volume-3d22d217-f099-4ee7-97ab-42ab56172629 (3d22d217-f099-4ee7-97ab-42ab56172629): created successfully Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e104e88d-17dc-4cd1-be14-68f3398b42b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:06:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Flow 'volume_create_manager' (1b1f81d7-3829-4280-9df2-2795de2a05f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:06:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ea82de14-46b2-441c-b13d-1aa53c355c14 tempest-VolumesImageMetadata-1176023731 None] Created volume successfully. Feb 24 11:07:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Acquiring lock "cinder-3d22d217-f099-4ee7-97ab-42ab56172629-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Lock "cinder-3d22d217-f099-4ee7-97ab-42ab56172629-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Acquiring lock "cinder-quobyte-3d22d217-f099-4ee7-97ab-42ab56172629" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Lock "cinder-quobyte-3d22d217-f099-4ee7-97ab-42ab56172629" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:00 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf02f9d-b2cf-492e-a24c-9ae273f42db6]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:00 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 Feb 24 11:07:00 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:00 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629" returned: 0 in 0.536s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:00 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 Feb 24 11:07:00 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:01 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629" returned: 1 in 0.501s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:01 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629 Feb 24 11:07:01 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:01 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-3d22d217-f099-4ee7-97ab-42ab56172629" returned: 0 in 0.445s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Lock "cinder-quobyte-3d22d217-f099-4ee7-97ab-42ab56172629" released by "delete_volume" :: held 1.527s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Created reservations ['9bccfb95-bedc-4344-9ad4-9a9d7f1be624', '7b951ce3-7c03-4e29-ab4c-54cfa403f67e', '54232931-4820-4259-815a-6fd1f364ae6c', '71624252-6251-4190-901a-0e741649ee3b'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:01 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:01 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:02 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.406s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:02 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:02 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Deleted volume successfully. Feb 24 11:07:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bedde986-c79c-4943-bf9b-9bf099274ddf tempest-VolumesImageMetadata-1176023731 None] Lock "cinder-3d22d217-f099-4ee7-97ab-42ab56172629-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Flow 'volume_create_manager' (3697c5a6-6535-48cb-9988-a3f516706877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63276b8-58d2-45fa-b485-e867745c8efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63276b8-58d2-45fa-b485-e867745c8efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1901441046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d946d5b8-d974-42e3-a5a4-89580351d669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807a7dd6158e469689d529acd2a23d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:04Z,use_quota=True,user_id='a82baeb7ce0c449284c9bd38a65ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf65f8fc-838b-46ca-a44f-3797bad220da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf65f8fc-838b-46ca-a44f-3797bad220da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7209d5ed-122c-4109-9157-15cc4d003612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7209d5ed-122c-4109-9157-15cc4d003612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd946d5b8-d974-42e3-a5a4-89580351d669', 'volume_name': 'volume-d946d5b8-d974-42e3-a5a4-89580351d669', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969a5291-bc6a-44cb-8c60-b58ce983deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969a5291-bc6a-44cb-8c60-b58ce983deef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5af686-816c-47b8-91b7-aea363c77609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:04 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Volume d946d5b8-d974-42e3-a5a4-89580351d669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d946d5b8-d974-42e3-a5a4-89580351d669', 'volume_size': 1} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1901441046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d946d5b8-d974-42e3-a5a4-89580351d669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807a7dd6158e469689d529acd2a23d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:04Z,use_quota=True,user_id='a82baeb7ce0c449284c9bd38a65ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Creating volume d946d5b8-d974-42e3-a5a4-89580351d669 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:04 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:04 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 1073741824 Feb 24 11:07:04 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:04 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 1073741824" returned: 0 in 0.505s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:04 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 Feb 24 11:07:04 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:05 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669" returned: 0 in 0.445s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5af686-816c-47b8-91b7-aea363c77609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d946d5b8-d974-42e3-a5a4-89580351d669', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2578b5b-8134-460d-b2b0-6f3e5f6ea6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:05 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Volume volume-d946d5b8-d974-42e3-a5a4-89580351d669 (d946d5b8-d974-42e3-a5a4-89580351d669): created successfully Feb 24 11:07:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2578b5b-8134-460d-b2b0-6f3e5f6ea6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Flow 'volume_create_manager' (3697c5a6-6535-48cb-9988-a3f516706877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:05 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9f4bcd7a-6eae-454f-a739-bcb1b86dcab0 tempest-SnapshotMetadataTestJSON-108707471 None] Created volume successfully. Feb 24 11:07:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Creating offline snapshot 3bbe6842-66e8-4ab9-a314-0139083aaeaf of volume d946d5b8-d974-42e3-a5a4-89580351d669 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:07:06 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406d3bb-39ac-439e-9a25-317b259609ef]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:06 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 Feb 24 11:07:06 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:06 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669" returned: 0 in 0.479s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:06 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf 1G Feb 24 11:07:06 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:07 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf 1G" returned: 0 in 0.457s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d946d5b8-d974-42e3-a5a4-89580351d669 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:07 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d946d5b8-d974-42e3-a5a4-89580351d669 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf Feb 24 11:07:07 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:07 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d946d5b8-d974-42e3-a5a4-89580351d669 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf" returned: 0 in 0.410s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:07 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf is being set with open permissions: ugo+rw Feb 24 11:07:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:07 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf Feb 24 11:07:07 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:08 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf" returned: 0 in 0.409s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:08 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.info Feb 24 11:07:08 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:08 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.info" returned: 0 in 0.414s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:08 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.info is being set with open permissions: ugo+rw Feb 24 11:07:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:08 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.info Feb 24 11:07:08 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:08 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.info" returned: 0 in 0.414s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:08 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-30ae3b2e-dc12-43eb-81ca-1ea7b20d36bb tempest-SnapshotMetadataTestJSON-108707471 None] Create snapshot completed successfully Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "cinder-3bbe6842-66e8-4ab9-a314-0139083aaeaf-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-3bbe6842-66e8-4ab9-a314-0139083aaeaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "cinder-quobyte-d946d5b8-d974-42e3-a5a4-89580351d669" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-quobyte-d946d5b8-d974-42e3-a5a4-89580351d669" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "cinder-quobyte-3bbe6842-66e8-4ab9-a314-0139083aaeaf" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-quobyte-3bbe6842-66e8-4ab9-a314-0139083aaeaf" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Deleting offline snapshot 3bbe6842-66e8-4ab9-a314-0139083aaeaf of volume d946d5b8-d974-42e3-a5a4-89580351d669 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] snapshot_file for this snap is: volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0032aebb-f41d-4252-95f5-c2a774a6f715]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:09 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf Feb 24 11:07:09 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:10 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf" returned: 0 in 0.475s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:10 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d946d5b8-d974-42e3-a5a4-89580351d669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:07:10 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f08ce48-bab7-4fc4-8fa3-076c6b7a715d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:10 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 Feb 24 11:07:10 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:10 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669" returned: 0 in 0.468s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:10 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf Feb 24 11:07:10 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:11 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf" returned: 0 in 0.458s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:11 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf Feb 24 11:07:11 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:11 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669.3bbe6842-66e8-4ab9-a314-0139083aaeaf" returned: 0 in 0.402s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-quobyte-3bbe6842-66e8-4ab9-a314-0139083aaeaf" released by "_delete_snapshot" :: held 1.857s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-quobyte-d946d5b8-d974-42e3-a5a4-89580351d669" released by "delete_snapshot" :: held 1.870s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:11 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Created reservations ['63589a39-ff31-4b3c-bb9c-193570886de2', 'ece29f73-a08b-4a95-9658-8639f4a5471d', '2eee09f3-418d-4825-8ae5-6b993db63ce9', '135299ad-8bc3-418e-bc4a-6f4a8d6aec53'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Delete snapshot completed successfully. Feb 24 11:07:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4c24f08b-2018-4641-b321-ee5df401034a tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-3bbe6842-66e8-4ab9-a314-0139083aaeaf-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "cinder-d946d5b8-d974-42e3-a5a4-89580351d669-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-d946d5b8-d974-42e3-a5a4-89580351d669-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "cinder-quobyte-d946d5b8-d974-42e3-a5a4-89580351d669" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-quobyte-d946d5b8-d974-42e3-a5a4-89580351d669" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e229cc4-35f5-4135-8d5f-ef64ce6f85e6]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:12 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 Feb 24 11:07:12 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:12 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669" returned: 0 in 0.477s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:12 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669 Feb 24 11:07:12 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:12 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d946d5b8-d974-42e3-a5a4-89580351d669" returned: 0 in 0.427s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-quobyte-d946d5b8-d974-42e3-a5a4-89580351d669" released by "delete_volume" :: held 0.941s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Created reservations ['f667d14e-263d-4432-af9c-3607a7563094', 'f4694f7c-f7ed-4bbd-86e6-6eb3c35879b2', 'ef822a17-9f8f-4cbb-9ead-4470f3d90483', '0509bc0e-5853-498c-b3cc-240dccdbb603'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:13 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:13 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:13 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.422s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Deleted volume successfully. Feb 24 11:07:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6f6a9b2e-1abb-465e-a7ad-0a9cf9eae617 tempest-SnapshotMetadataTestJSON-108707471 None] Lock "cinder-d946d5b8-d974-42e3-a5a4-89580351d669-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Flow 'volume_create_manager' (ff253a44-cb21-4aad-8a4a-b7fbb1e5ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fff2d-d8bb-49b8-85d5-79422bc3a65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fff2d-d8bb-49b8-85d5-79422bc3a65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-78373850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afca1f20-3d3e-49ea-a1d1-435b3c56cb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a1a3b0c9bf4f1db2edaa73dcaad185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:15Z,use_quota=True,user_id='e84bd315757740fc8ec0b3019a544d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1672300c-d937-472f-a877-3e7c08f56e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1672300c-d937-472f-a877-3e7c08f56e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b943ea25-6cdf-409d-a349-194b8f6a0bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b943ea25-6cdf-409d-a349-194b8f6a0bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afca1f20-3d3e-49ea-a1d1-435b3c56cb98', 'volume_name': 'volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3a14cc-e02d-4ce3-ab64-3689a6a0aee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3a14cc-e02d-4ce3-ab64-3689a6a0aee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70916c06-561e-4495-8b25-58e768950887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:15 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Volume afca1f20-3d3e-49ea-a1d1-435b3c56cb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98', 'volume_size': 1} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-78373850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afca1f20-3d3e-49ea-a1d1-435b3c56cb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a1a3b0c9bf4f1db2edaa73dcaad185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:15Z,use_quota=True,user_id='e84bd315757740fc8ec0b3019a544d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Creating volume afca1f20-3d3e-49ea-a1d1-435b3c56cb98 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:15 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:15 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 1073741824 Feb 24 11:07:15 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:15 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 1073741824" returned: 0 in 0.489s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:15 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 Feb 24 11:07:15 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:16 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98" returned: 0 in 0.433s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:16 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70916c06-561e-4495-8b25-58e768950887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:16 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373aa975-5f40-468b-a306-b1b9a7b25f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:16 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Volume volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 (afca1f20-3d3e-49ea-a1d1-435b3c56cb98): created successfully Feb 24 11:07:16 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373aa975-5f40-468b-a306-b1b9a7b25f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:16 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Flow 'volume_create_manager' (ff253a44-cb21-4aad-8a4a-b7fbb1e5ded3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:16 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3fc3face-4e37-49c0-8349-c46ccdcc64fa tempest-AbsoluteLimitsTests-321717229 None] Created volume successfully. Feb 24 11:07:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Acquiring lock "cinder-afca1f20-3d3e-49ea-a1d1-435b3c56cb98-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Lock "cinder-afca1f20-3d3e-49ea-a1d1-435b3c56cb98-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Acquiring lock "cinder-quobyte-afca1f20-3d3e-49ea-a1d1-435b3c56cb98" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Lock "cinder-quobyte-afca1f20-3d3e-49ea-a1d1-435b3c56cb98" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:17 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae3bb8b-71af-4328-8426-1ddbd78dfc23]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:17 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 Feb 24 11:07:17 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:18 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98" returned: 0 in 0.501s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:18 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98 Feb 24 11:07:18 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:18 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-afca1f20-3d3e-49ea-a1d1-435b3c56cb98" returned: 0 in 0.422s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Lock "cinder-quobyte-afca1f20-3d3e-49ea-a1d1-435b3c56cb98" released by "delete_volume" :: held 0.950s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Created reservations ['07309dd7-e3d6-45fc-bce9-756f8a70b3ab', 'fb9544e1-4ba6-4193-9ce1-92b35236f48e', '37c2cbe8-cf0b-454d-a910-4615485e5a22', '96ce410b-a165-4a05-ab19-1526916d474a'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:18 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:18 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:19 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.448s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:19 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Deleted volume successfully. Feb 24 11:07:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5141da44-8379-4a79-8c4a-d72b3dc2b57e tempest-AbsoluteLimitsTests-321717229 None] Lock "cinder-afca1f20-3d3e-49ea-a1d1-435b3c56cb98-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=98,cinder:INSERT=43,cinder:UPDATE=140,cinder:DELETE=9 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:INSERT=32,cinder:UPDATE=125,cinder:SELECT=87,cinder:DELETE=13 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (f4ffe3c2-10bb-4ad8-a249-b512cbbf3e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33741eee-11ab-409a-b2f4-1e5ae35afddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33741eee-11ab-409a-b2f4-1e5ae35afddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-492916336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e951a442-884b-49fe-988f-2289861a9d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:21Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8a832f-e57b-48e4-bb9b-2c319b455e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8a832f-e57b-48e4-bb9b-2c319b455e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6abe16-2d1c-4cac-b338-9b1f523a5ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6abe16-2d1c-4cac-b338-9b1f523a5ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e951a442-884b-49fe-988f-2289861a9d9d', 'volume_name': 'volume-e951a442-884b-49fe-988f-2289861a9d9d', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19620e4-5a75-43cd-b021-b0e057fe88b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19620e4-5a75-43cd-b021-b0e057fe88b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fe3212-f916-456b-a83b-5853843b56ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:20 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume e951a442-884b-49fe-988f-2289861a9d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e951a442-884b-49fe-988f-2289861a9d9d', 'volume_size': 1} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-492916336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e951a442-884b-49fe-988f-2289861a9d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:21Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Creating volume e951a442-884b-49fe-988f-2289861a9d9d {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:20 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:20 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d 1073741824 Feb 24 11:07:20 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:21 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d 1073741824" returned: 0 in 0.482s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:21 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d Feb 24 11:07:21 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:21 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d" returned: 0 in 0.429s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fe3212-f916-456b-a83b-5853843b56ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e951a442-884b-49fe-988f-2289861a9d9d', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa00ae67-fcfc-4e8b-9e51-f569e7a5617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:21 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume volume-e951a442-884b-49fe-988f-2289861a9d9d (e951a442-884b-49fe-988f-2289861a9d9d): created successfully Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa00ae67-fcfc-4e8b-9e51-f569e7a5617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (f4ffe3c2-10bb-4ad8-a249-b512cbbf3e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8235610d-7ed4-4de9-8d4c-0bc7baebec5c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created volume successfully. Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (20e85265-d1bc-4a07-a036-291197071bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878b0a28-1992-439e-91b7-361b025760d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878b0a28-1992-439e-91b7-361b025760d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1499834804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e48ebbb-263e-4e02-a214-e5fe1c549a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:23Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5cea9d-ef84-44b2-83f4-4643a1964d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5cea9d-ef84-44b2-83f4-4643a1964d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705439a5-d7f2-47a8-bd80-44632f4ed216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705439a5-d7f2-47a8-bd80-44632f4ed216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e48ebbb-263e-4e02-a214-e5fe1c549a0f', 'volume_name': 'volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80bd448-a4c2-4064-9d48-c44c69610afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80bd448-a4c2-4064-9d48-c44c69610afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2a4330-3c62-4bee-8acf-aebf19744c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume 0e48ebbb-263e-4e02-a214-e5fe1c549a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f', 'volume_size': 1} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1499834804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e48ebbb-263e-4e02-a214-e5fe1c549a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:23Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Creating volume 0e48ebbb-263e-4e02-a214-e5fe1c549a0f {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:23 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:23 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f 1073741824 Feb 24 11:07:23 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (f81e7938-6f4a-4972-9288-929b94ee6d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640e1ed6-3d91-4d35-9be8-965d57952395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640e1ed6-3d91-4d35-9be8-965d57952395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944314165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1913571-3134-48fd-bcb9-56a340526d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:23Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6b2d92-8d33-4544-99b2-3b287e168ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6b2d92-8d33-4544-99b2-3b287e168ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc655ad-3b5c-44ab-b9bc-231963bad577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc655ad-3b5c-44ab-b9bc-231963bad577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1913571-3134-48fd-bcb9-56a340526d93', 'volume_name': 'volume-a1913571-3134-48fd-bcb9-56a340526d93', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9057ab1-0d4c-465f-abfa-3ab60ab5171a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9057ab1-0d4c-465f-abfa-3ab60ab5171a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0889ed7-fcd1-41d9-b6df-765d07955fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume a1913571-3134-48fd-bcb9-56a340526d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1913571-3134-48fd-bcb9-56a340526d93', 'volume_size': 1} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (180fe32b-3b8e-4e5f-a13b-fbca52d7872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1736ef25-c6f0-45ad-b941-0ec699e913e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1736ef25-c6f0-45ad-b941-0ec699e913e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553843368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f8e77f-6f84-4552-9261-be10458b229b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:24Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9be81b-a8ab-4b86-b22f-b0a90e31b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9be81b-a8ab-4b86-b22f-b0a90e31b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889b696a-b24d-4a5d-8f99-cc4cd55656c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889b696a-b24d-4a5d-8f99-cc4cd55656c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f8e77f-6f84-4552-9261-be10458b229b', 'volume_name': 'volume-48f8e77f-6f84-4552-9261-be10458b229b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bea860-e1a0-47c7-972e-dc67e348f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bea860-e1a0-47c7-972e-dc67e348f005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdf4bc1-a6d3-461d-a847-807cfca83f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume 48f8e77f-6f84-4552-9261-be10458b229b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f8e77f-6f84-4552-9261-be10458b229b', 'volume_size': 1} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (0f0a5d27-8df4-43f7-a89b-9aae7e2b05b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa9593f-3a6c-4bf4-b4b4-35719f41d26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa9593f-3a6c-4bf4-b4b4-35719f41d26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91453706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b5ef15-a30a-421f-ae1b-b9d02427f4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:24Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43c1eab-af0b-482f-b46c-5e2a270241cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43c1eab-af0b-482f-b46c-5e2a270241cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0687e117-3f2e-4d2c-a4aa-f221d25b8740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0687e117-3f2e-4d2c-a4aa-f221d25b8740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b5ef15-a30a-421f-ae1b-b9d02427f4e9', 'volume_name': 'volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0c9ae8-7dd7-404c-94a8-a6efba46f09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0c9ae8-7dd7-404c-94a8-a6efba46f09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d768c3da-b176-427b-8a89-4fdde576e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:23 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume 29b5ef15-a30a-421f-ae1b-b9d02427f4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9', 'volume_size': 1} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:23 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f 1073741824" returned: 0 in 0.619s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:23 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f Feb 24 11:07:23 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (3d8b8207-a107-4653-9941-8233e1429435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd203d2d-bb1e-4809-865b-a799eba345fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd203d2d-bb1e-4809-865b-a799eba345fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-10562586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afb4935-07b7-488a-9f86-612fc4f33794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:24Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20070b8-5bc1-425e-ae0b-1caaf0553eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20070b8-5bc1-425e-ae0b-1caaf0553eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f795182-5fcc-4847-aaf5-b12035d64aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f795182-5fcc-4847-aaf5-b12035d64aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afb4935-07b7-488a-9f86-612fc4f33794', 'volume_name': 'volume-6afb4935-07b7-488a-9f86-612fc4f33794', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a455bc-7428-49d8-9c38-6728d04f6ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a455bc-7428-49d8-9c38-6728d04f6ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5036fd-7c80-462a-a72a-c78ecd459651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:24 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume 6afb4935-07b7-488a-9f86-612fc4f33794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afb4935-07b7-488a-9f86-612fc4f33794', 'volume_size': 1} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:24 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f" returned: 0 in 0.434s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.895s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944314165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1913571-3134-48fd-bcb9-56a340526d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:23Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Creating volume a1913571-3134-48fd-bcb9-56a340526d93 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:24 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2a4330-3c62-4bee-8acf-aebf19744c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:24 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 1073741824 Feb 24 11:07:24 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655e3157-9840-4350-811f-8f1b1da902e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:24 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f (0e48ebbb-263e-4e02-a214-e5fe1c549a0f): created successfully Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655e3157-9840-4350-811f-8f1b1da902e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (20e85265-d1bc-4a07-a036-291197071bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:24 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5c59a130-0a79-46e0-b156-289a1bc7b6f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created volume successfully. Feb 24 11:07:24 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 1073741824" returned: 0 in 0.484s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:24 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 Feb 24 11:07:24 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:25 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93" returned: 0 in 0.399s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553843368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f8e77f-6f84-4552-9261-be10458b229b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:24Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Creating volume 48f8e77f-6f84-4552-9261-be10458b229b {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:25 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0889ed7-fcd1-41d9-b6df-765d07955fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1913571-3134-48fd-bcb9-56a340526d93', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:25 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b 1073741824 Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1957c995-6c7b-49e2-9501-72ae6d86c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:25 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:25 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume volume-a1913571-3134-48fd-bcb9-56a340526d93 (a1913571-3134-48fd-bcb9-56a340526d93): created successfully Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1957c995-6c7b-49e2-9501-72ae6d86c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (f81e7938-6f4a-4972-9288-929b94ee6d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:25 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0222a45f-6370-4054-a0e2-40c63557f917 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created volume successfully. Feb 24 11:07:25 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b 1073741824" returned: 0 in 0.461s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:25 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b Feb 24 11:07:25 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:26 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b" returned: 0 in 0.419s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.311s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91453706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b5ef15-a30a-421f-ae1b-b9d02427f4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:24Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Creating volume 29b5ef15-a30a-421f-ae1b-b9d02427f4e9 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:26 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdf4bc1-a6d3-461d-a847-807cfca83f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f8e77f-6f84-4552-9261-be10458b229b', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:26 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 1073741824 Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea772165-1f16-4059-8685-ad71d68d8136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:26 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:26 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume volume-48f8e77f-6f84-4552-9261-be10458b229b (48f8e77f-6f84-4552-9261-be10458b229b): created successfully Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea772165-1f16-4059-8685-ad71d68d8136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (180fe32b-3b8e-4e5f-a13b-fbca52d7872a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:26 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0a5dd458-e61b-44ec-bc3b-ca7732a2f8e1 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created volume successfully. Feb 24 11:07:26 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 1073741824" returned: 0 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:26 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 Feb 24 11:07:26 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:27 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9" returned: 0 in 0.431s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.059s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-10562586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afb4935-07b7-488a-9f86-612fc4f33794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419c6cfe51454aa88a294d2c7748f259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:24Z,use_quota=True,user_id='91935d2c22324fb38e93218a71d50029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Creating volume 6afb4935-07b7-488a-9f86-612fc4f33794 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:27 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d768c3da-b176-427b-8a89-4fdde576e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11896534-de57-4b87-837d-4e1e46c9a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:27 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 1073741824 Feb 24 11:07:27 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:27 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 (29b5ef15-a30a-421f-ae1b-b9d02427f4e9): created successfully Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11896534-de57-4b87-837d-4e1e46c9a805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (0f0a5d27-8df4-43f7-a89b-9aae7e2b05b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:27 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b1fcd160-93ce-4c9a-95ce-794e1c3e11c0 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created volume successfully. Feb 24 11:07:27 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 1073741824" returned: 0 in 0.462s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:27 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 Feb 24 11:07:27 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:28 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794" returned: 0 in 0.431s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5036fd-7c80-462a-a72a-c78ecd459651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afb4935-07b7-488a-9f86-612fc4f33794', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e58ff5-d24f-4a2b-9515-d7a393b38f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:28 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Volume volume-6afb4935-07b7-488a-9f86-612fc4f33794 (6afb4935-07b7-488a-9f86-612fc4f33794): created successfully Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e58ff5-d24f-4a2b-9515-d7a393b38f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Flow 'volume_create_manager' (3d8b8207-a107-4653-9941-8233e1429435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-8100326f-af98-4b6a-a393-7f95563e0b43 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created volume successfully. Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-6afb4935-07b7-488a-9f86-612fc4f33794-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-6afb4935-07b7-488a-9f86-612fc4f33794-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-quobyte-6afb4935-07b7-488a-9f86-612fc4f33794" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-6afb4935-07b7-488a-9f86-612fc4f33794" acquired by "delete_volume" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1c053b-b50b-45d9-9c77-d6d27df9722f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:28 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 Feb 24 11:07:28 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:29 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794" returned: 0 in 0.502s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:29 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794 Feb 24 11:07:29 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:29 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6afb4935-07b7-488a-9f86-612fc4f33794" returned: 0 in 0.392s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-6afb4935-07b7-488a-9f86-612fc4f33794" released by "delete_volume" :: held 0.920s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created reservations ['c070ab39-4a03-4fb0-9c52-bf6372f932ef', '7bbba186-4ea8-417c-89d5-ed01a8093be0', 'daa1f952-54c5-4100-99b4-69ec4a073354', '28eb2179-dfd9-44c9-afd4-18d10af20303'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:29 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:29 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-29b5ef15-a30a-421f-ae1b-b9d02427f4e9-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-29b5ef15-a30a-421f-ae1b-b9d02427f4e9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-quobyte-29b5ef15-a30a-421f-ae1b-b9d02427f4e9" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-29b5ef15-a30a-421f-ae1b-b9d02427f4e9" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5494fc89-70d6-42d3-af12-79dc07faed5b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:29 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 Feb 24 11:07:29 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:29 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.422s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:29 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Deleted volume successfully. Feb 24 11:07:29 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c87b0810-f712-4cce-bbb6-598701ccf6b9 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-6afb4935-07b7-488a-9f86-612fc4f33794-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:30 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9" returned: 0 in 0.519s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:30 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9 Feb 24 11:07:30 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:30 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-29b5ef15-a30a-421f-ae1b-b9d02427f4e9" returned: 0 in 0.398s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-29b5ef15-a30a-421f-ae1b-b9d02427f4e9" released by "delete_volume" :: held 0.945s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created reservations ['7a147649-9169-4e83-b51c-9844797057d4', '1d08b5aa-0d6b-443b-8b37-6c2b46184b26', '0d625cf0-fc65-4154-83b5-7520d3dfe9cf', 'ff0c18c0-c38b-4023-9b5b-915871dafb11'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:30 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:30 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-48f8e77f-6f84-4552-9261-be10458b229b-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-48f8e77f-6f84-4552-9261-be10458b229b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-quobyte-48f8e77f-6f84-4552-9261-be10458b229b" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-48f8e77f-6f84-4552-9261-be10458b229b" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[be21b97d-1b06-4a1c-939e-fcf2f73b42e2]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:30 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b Feb 24 11:07:30 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:31 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.440s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:31 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Deleted volume successfully. Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a5851ec8-438b-4226-8e6e-cd0fd522fe49 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-29b5ef15-a30a-421f-ae1b-b9d02427f4e9-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:31 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b" returned: 0 in 0.497s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:31 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b Feb 24 11:07:31 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:31 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-48f8e77f-6f84-4552-9261-be10458b229b" returned: 0 in 0.394s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-48f8e77f-6f84-4552-9261-be10458b229b" released by "delete_volume" :: held 0.917s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created reservations ['8c8c8fe9-30e3-4bae-adba-0e305956ba6e', 'b310cc97-a405-4ca7-b990-421189d7ae88', 'a20db265-beb9-4eda-89c1-92d4ee5b3636', 'c3d1c377-f1f2-452b-8042-a4416c1696b1'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:31 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:31 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-a1913571-3134-48fd-bcb9-56a340526d93-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-a1913571-3134-48fd-bcb9-56a340526d93-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-quobyte-a1913571-3134-48fd-bcb9-56a340526d93" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-a1913571-3134-48fd-bcb9-56a340526d93" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5dac25-9533-43f5-8c8d-b2d249e8256f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:31 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 Feb 24 11:07:31 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:32 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.418s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:32 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Deleted volume successfully. Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c982d535-6777-47dc-884b-bf54224b208f tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-48f8e77f-6f84-4552-9261-be10458b229b-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:32 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:32 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93 Feb 24 11:07:32 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:32 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-a1913571-3134-48fd-bcb9-56a340526d93" returned: 0 in 0.382s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-a1913571-3134-48fd-bcb9-56a340526d93" released by "delete_volume" :: held 0.881s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created reservations ['cf8af54a-24c4-45fb-b139-51f554fd2a77', '2a6ac87d-2dfe-4c61-a4c2-34e81a380b9d', '4b6b6fbe-619c-4a56-b256-ad10ced01f25', '9834840f-7e33-455e-a276-7bee21900301'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:32 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:32 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-0e48ebbb-263e-4e02-a214-e5fe1c549a0f-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-0e48ebbb-263e-4e02-a214-e5fe1c549a0f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-quobyte-0e48ebbb-263e-4e02-a214-e5fe1c549a0f" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-0e48ebbb-263e-4e02-a214-e5fe1c549a0f" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0db17f-8694-4ff4-804d-e71caf45b753]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:33 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f Feb 24 11:07:33 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:33 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.438s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Deleted volume successfully. Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-fe5dee1e-c310-4f0b-bfb9-29d23b30076c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-a1913571-3134-48fd-bcb9-56a340526d93-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:33 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f" returned: 0 in 0.483s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:33 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f Feb 24 11:07:33 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:33 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0e48ebbb-263e-4e02-a214-e5fe1c549a0f" returned: 0 in 0.436s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-0e48ebbb-263e-4e02-a214-e5fe1c549a0f" released by "delete_volume" :: held 0.940s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:33 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created reservations ['3e3a5c61-ac61-4d41-930c-5cb3bf4f17c4', '6e1dbc45-6d58-4795-9504-2797a42c320c', '9a68bcf0-8e43-402f-aa79-a6c2cf61ddb0', '3ac2bf57-0a7a-498b-9054-2ae1deffc533'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:34 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:34 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-e951a442-884b-49fe-988f-2289861a9d9d-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-e951a442-884b-49fe-988f-2289861a9d9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:34 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:34 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "cinder-quobyte-e951a442-884b-49fe-988f-2289861a9d9d" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-e951a442-884b-49fe-988f-2289861a9d9d" acquired by "delete_volume" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb47347-597a-4a58-94c9-98f26ba033c0]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:34 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d Feb 24 11:07:34 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:34 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.423s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Deleted volume successfully. Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-a3a9d0fb-8877-487a-bbb3-02a19db562f7 tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-0e48ebbb-263e-4e02-a214-e5fe1c549a0f-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:34 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.434s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:34 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d" returned: 0 in 0.475s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:34 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d Feb 24 11:07:34 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:35 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e951a442-884b-49fe-988f-2289861a9d9d" returned: 0 in 0.398s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-quobyte-e951a442-884b-49fe-988f-2289861a9d9d" released by "delete_volume" :: held 0.893s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Created reservations ['0a4fe464-2208-4c48-af7e-f355df24911e', '7d720cf3-9065-4180-b2d5-fbd3bdb0c86b', '2866156b-e7f5-49e7-8039-4d6191328bd6', 'f01d6859-4e77-4ed0-8288-76dbce47a986'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:35 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:07:35 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:35 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.459s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:07:35 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Deleted volume successfully. Feb 24 11:07:35 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-c291da2f-68ba-4a67-a97e-00ba5f5a839c tempest-CreateVolumesFromSourceVolumeTest-1129719262 None] Lock "cinder-e951a442-884b-49fe-988f-2289861a9d9d-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:45 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:UPDATE=56,cinder:SELECT=43,cinder:DELETE=6,cinder:INSERT=11 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:07:45 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=40,cinder:INSERT=19,cinder:UPDATE=75,cinder:DELETE=6 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Flow 'volume_create_manager' (b0c810bb-4786-45a5-b361-91b7e551de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78e2e74-8ada-4419-879a-7cabc094f21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78e2e74-8ada-4419-879a-7cabc094f21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1284108283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00736221-05ba-4386-b0c6-0ce5020e23e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438d124e34684f799e3766afea362598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:48Z,use_quota=True,user_id='d9385911deea42018f98692c7f8af848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e81369b-437e-49ac-bad6-b55dafd1c96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e81369b-437e-49ac-bad6-b55dafd1c96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1def497-cfce-4db8-8186-be996b22fe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1def497-cfce-4db8-8186-be996b22fe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00736221-05ba-4386-b0c6-0ce5020e23e5', 'volume_name': 'volume-00736221-05ba-4386-b0c6-0ce5020e23e5', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3435598a-5e48-4e7f-848b-8f48141b72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3435598a-5e48-4e7f-848b-8f48141b72c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d259c3-1f95-4bf1-a6a2-11121d0dbab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:48 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Volume 00736221-05ba-4386-b0c6-0ce5020e23e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00736221-05ba-4386-b0c6-0ce5020e23e5', 'volume_size': 1} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1284108283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00736221-05ba-4386-b0c6-0ce5020e23e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438d124e34684f799e3766afea362598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:48Z,use_quota=True,user_id='d9385911deea42018f98692c7f8af848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Creating volume 00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:48 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:48 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 1073741824 Feb 24 11:07:48 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:48 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 1073741824" returned: 0 in 0.483s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:49 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 Feb 24 11:07:49 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:49 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5" returned: 0 in 0.420s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:07:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d259c3-1f95-4bf1-a6a2-11121d0dbab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00736221-05ba-4386-b0c6-0ce5020e23e5', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d56704-18d2-45dc-8038-a58f96c6f8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:49 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Volume volume-00736221-05ba-4386-b0c6-0ce5020e23e5 (00736221-05ba-4386-b0c6-0ce5020e23e5): created successfully Feb 24 11:07:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d56704-18d2-45dc-8038-a58f96c6f8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:49 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Flow 'volume_create_manager' (b0c810bb-4786-45a5-b361-91b7e551de22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:49 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-efd7a2e4-d68c-4d66-9120-8007a9cf72d9 tempest-SnapshotDependencyTests-1756535984 None] Created volume successfully. Feb 24 11:07:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Creating offline snapshot 07444db7-5b0a-4ce9-b341-f1cf019703e2 of volume 00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:07:50 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c2c631-9fcf-4243-8ac2-c0ce901adcd1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:50 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 Feb 24 11:07:50 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:51 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5" returned: 0 in 0.440s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:51 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 1G Feb 24 11:07:51 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:51 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 1G" returned: 0 in 0.431s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00736221-05ba-4386-b0c6-0ce5020e23e5 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:51 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00736221-05ba-4386-b0c6-0ce5020e23e5 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 Feb 24 11:07:51 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:51 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00736221-05ba-4386-b0c6-0ce5020e23e5 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2" returned: 0 in 0.403s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:51 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 is being set with open permissions: ugo+rw Feb 24 11:07:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:52 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 Feb 24 11:07:52 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:52 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2" returned: 0 in 0.374s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:52 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.info Feb 24 11:07:52 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:52 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.info" returned: 0 in 0.416s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:52 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.info is being set with open permissions: ugo+rw Feb 24 11:07:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:52 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.info Feb 24 11:07:52 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:53 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.info" returned: 0 in 0.391s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:53 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6346860e-340c-450a-ba0d-b3b6599b8310 tempest-SnapshotDependencyTests-1756535984 None] Create snapshot completed successfully Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Flow 'volume_create_manager' (7c9e3a97-fb3f-4b4e-8f2a-2a1aeab5c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d12acdd-2bf4-4ee7-9a6d-ca0dc1adc247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d12acdd-2bf4-4ee7-9a6d-ca0dc1adc247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fab8262-96c7-4ad6-a880-8bd6ceb70d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438d124e34684f799e3766afea362598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07444db7-5b0a-4ce9-b341-f1cf019703e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:07:54Z,use_quota=True,user_id='d9385911deea42018f98692c7f8af848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efe323e-aea1-431f-8fa7-1ababb97a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efe323e-aea1-431f-8fa7-1ababb97a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e436ee-1b54-4ba1-8cdb-f2c85182bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e436ee-1b54-4ba1-8cdb-f2c85182bde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fab8262-96c7-4ad6-a880-8bd6ceb70d8a', 'volume_name': 'volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a', 'volume_size': 1, 'snapshot_id': '07444db7-5b0a-4ce9-b341-f1cf019703e2'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee1b3fc-e257-4131-a0bd-dc29c67925f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee1b3fc-e257-4131-a0bd-dc29c67925f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac884a69-0729-4301-80ee-d109f07f7ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:54 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Volume 2fab8262-96c7-4ad6-a880-8bd6ceb70d8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a', 'volume_size': 1, 'snapshot_id': '07444db7-5b0a-4ce9-b341-f1cf019703e2'} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-quobyte-07444db7-5b0a-4ce9-b341-f1cf019703e2-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" by "_create_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-07444db7-5b0a-4ce9-b341-f1cf019703e2-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Creating volume 2fab8262-96c7-4ad6-a880-8bd6ceb70d8a from snapshot 07444db7-5b0a-4ce9-b341-f1cf019703e2 {{(pid=82627) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-quobyte-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] snapshot: 07444db7-5b0a-4ce9-b341-f1cf019703e2, volume: 2fab8262-96c7-4ad6-a880-8bd6ceb70d8a, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa203d1-9af1-4129-b58a-aa49f5c9f9d3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:54 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 Feb 24 11:07:54 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:54 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2" returned: 0 in 0.445s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00736221-05ba-4386-b0c6-0ce5020e23e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847b836-053b-40a8-ad23-baa9324da80a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:54 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 Feb 24 11:07:54 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:55 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5" returned: 0 in 0.468s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:55 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:07:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:55 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a Feb 24 11:07:55 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:57 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" returned: 0 in 2.249s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[416344f8-df3d-4938-a5f4-fa6ffe9f2c1f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:57 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 Feb 24 11:07:57 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:57 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5" returned: 0 in 0.595s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:57 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:07:57 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Converted 1024.00 MB image at 454.92 MB/s Feb 24 11:07:57 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a is being set with open permissions: ugo+rw Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:58 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a Feb 24 11:07:58 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:07:58 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" returned: 0 in 0.402s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" released by "_copy_volume_from_snapshot" :: held 4.213s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-07444db7-5b0a-4ce9-b341-f1cf019703e2-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" released by "_create_volume_from_snapshot" :: held 4.227s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.235s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac884a69-0729-4301-80ee-d109f07f7ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a', 'volume_size': 1, 'snapshot_id': '07444db7-5b0a-4ce9-b341-f1cf019703e2'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cfdad0-d8ec-49f4-93eb-9bfbeffc7946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:07:58 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Volume volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a (2fab8262-96c7-4ad6-a880-8bd6ceb70d8a): created successfully Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cfdad0-d8ec-49f4-93eb-9bfbeffc7946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:07:58 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Flow 'volume_create_manager' (7c9e3a97-fb3f-4b4e-8f2a-2a1aeab5c5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:07:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d4c8dc5c-758b-43a4-b730-ac271c69c017 tempest-SnapshotDependencyTests-1756535984 None] Created volume successfully. Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-07444db7-5b0a-4ce9-b341-f1cf019703e2-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-07444db7-5b0a-4ce9-b341-f1cf019703e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-quobyte-00736221-05ba-4386-b0c6-0ce5020e23e5" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-00736221-05ba-4386-b0c6-0ce5020e23e5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-quobyte-07444db7-5b0a-4ce9-b341-f1cf019703e2" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-07444db7-5b0a-4ce9-b341-f1cf019703e2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Deleting offline snapshot 07444db7-5b0a-4ce9-b341-f1cf019703e2 of volume 00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] snapshot_file for this snap is: volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7703f9db-d159-4185-a8e7-699164e5f4fa]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:07:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:07:59 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 Feb 24 11:07:59 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:00 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2" returned: 0 in 0.506s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00736221-05ba-4386-b0c6-0ce5020e23e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:08:00 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b6561-84f9-4572-91a4-693950bf7bd8]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:08:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:00 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 Feb 24 11:08:00 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:00 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5" returned: 0 in 0.499s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:00 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 Feb 24 11:08:00 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:01 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2" returned: 0 in 0.454s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:01 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2 Feb 24 11:08:01 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:01 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5.07444db7-5b0a-4ce9-b341-f1cf019703e2" returned: 0 in 0.442s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-07444db7-5b0a-4ce9-b341-f1cf019703e2" released by "_delete_snapshot" :: held 1.958s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-00736221-05ba-4386-b0c6-0ce5020e23e5" released by "delete_snapshot" :: held 1.976s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Created reservations ['5b6daaeb-43a4-4567-88c7-4b4ff0e73b8b', '61933938-c590-42c6-8f47-f03d29eebd8a', '071befa3-88fe-4d10-b9b8-e054932d9bf1', '119ec539-1183-49d0-87a3-a1e66f25ca04'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:08:01 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Delete snapshot completed successfully. Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-aa29633d-8bbe-4525-b500-4f441687199b tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-07444db7-5b0a-4ce9-b341-f1cf019703e2-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-00736221-05ba-4386-b0c6-0ce5020e23e5-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-00736221-05ba-4386-b0c6-0ce5020e23e5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-quobyte-00736221-05ba-4386-b0c6-0ce5020e23e5" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-00736221-05ba-4386-b0c6-0ce5020e23e5" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[58423959-d83a-4290-8c69-9b3af989718e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:08:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:01 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 Feb 24 11:08:01 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:02 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5" returned: 0 in 0.493s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:02 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5 Feb 24 11:08:02 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:02 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-00736221-05ba-4386-b0c6-0ce5020e23e5" returned: 0 in 0.424s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-00736221-05ba-4386-b0c6-0ce5020e23e5" released by "delete_volume" :: held 0.955s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Created reservations ['92d3f3d6-addd-4c2d-9927-2c8979fbf6c1', 'fffd5f65-8e79-4d82-9bdd-df99f6638292', '62ad5d73-9b65-465a-8ace-2e92d0261e11', '6b96c6a1-4508-42a6-91a5-8e13b0243b2d'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:02 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:08:02 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "cinder-quobyte-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ae287-fe54-4967-9b8b-325b322870a8]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:08:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:02 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a Feb 24 11:08:02 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:03 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.415s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:08:03 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Deleted volume successfully. Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-692fbf26-b25e-4a47-ae11-1adffffea301 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-00736221-05ba-4386-b0c6-0ce5020e23e5-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:08:03 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" returned: 0 in 0.492s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:03 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a Feb 24 11:08:03 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:03 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" returned: 0 in 0.425s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-quobyte-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a" released by "delete_volume" :: held 0.947s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Created reservations ['5f8ad152-8412-479f-ae5b-9d7fb667d1d8', '342caddc-7c8d-4e5b-8d30-63c8e224d96f', '8ffe33f2-43bc-4924-b6ae-4d125f364d6c', '1f6c28a0-3306-49f3-b04a-910fc4d84025'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:08:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:03 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:08:03 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:04 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.460s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:04 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:08:04 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Deleted volume successfully. Feb 24 11:08:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f82e6bcf-fd3c-4bc2-b021-7e1ba61b1721 tempest-SnapshotDependencyTests-1756535984 None] Lock "cinder-2fab8262-96c7-4ad6-a880-8bd6ceb70d8a-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:08:13 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=20,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=1 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:08:14 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=4 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:08:32 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:08:34 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:08:34 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:08:34 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.413s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:08:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:14 devstack cinder-volume[82627]: INFO cinder.volume.manager [req-45d6d302-f808-4a0e-bcbc-2e754afd691f req-71dd3558-6287-49f3-a61b-87cea6670ecd tempest-TestVolumeBootPattern-1051066020 None] Terminate volume connection completed successfully. Feb 24 11:09:14 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [req-45d6d302-f808-4a0e-bcbc-2e754afd691f req-71dd3558-6287-49f3-a61b-87cea6670ecd tempest-TestVolumeBootPattern-1051066020 None] Deleting attachment cad52321-e726-440a-93e3-282005ab404e. {{(pid=82627) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 24 11:09:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Acquiring lock "cinder-51699275-b086-49ef-8ff2-09bd4c74343d-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Lock "cinder-51699275-b086-49ef-8ff2-09bd4c74343d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Acquiring lock "cinder-quobyte-51699275-b086-49ef-8ff2-09bd4c74343d" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Lock "cinder-quobyte-51699275-b086-49ef-8ff2-09bd4c74343d" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:17 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c878b6ea-8b52-494d-92cf-2d3ad73c24d8]: (4, 'raw') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:17 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:09:17 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:18 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 0 in 0.470s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:18 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:09:18 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:18 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 1 in 0.482s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d' failed. Not Retrying. {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 24 11:09:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:18 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d Feb 24 11:09:18 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:18 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-51699275-b086-49ef-8ff2-09bd4c74343d" returned: 0 in 0.404s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Lock "cinder-quobyte-51699275-b086-49ef-8ff2-09bd4c74343d" released by "delete_volume" :: held 1.399s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:18 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Created reservations ['0eab7b31-d000-4932-848e-3590fae227c5', '7f76d52d-87db-40fe-839d-b3d57aecc4e4', '3eb4ef0b-a7ff-4505-a7c2-a30a5d5d3385', '355cfc9d-7e73-4782-801b-ca145de15351'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:19 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:19 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:19 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.406s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Deleted volume successfully. Feb 24 11:09:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-62b5839e-4792-4d01-b3fe-ff739a5e6740 tempest-TestVolumeBootPattern-1051066020 None] Lock "cinder-51699275-b086-49ef-8ff2-09bd4c74343d-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:29 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:09:29 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (bcaae1d5-b3cd-4264-a10e-b6dace83119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b8bff2-032b-403b-9ed3-f463ffa630fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b8bff2-032b-403b-9ed3-f463ffa630fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-504899845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3686ad-37e0-4110-a222-4f0c63f535cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831e854d-803b-4694-8e8c-bef2851bff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831e854d-803b-4694-8e8c-bef2851bff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b303659-4897-47e8-b98e-032d9926a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b303659-4897-47e8-b98e-032d9926a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3686ad-37e0-4110-a222-4f0c63f535cd', 'volume_name': 'volume-2d3686ad-37e0-4110-a222-4f0c63f535cd', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bd77b6-c2a5-4b6c-93c8-ae89fe4142e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bd77b6-c2a5-4b6c-93c8-ae89fe4142e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b803d5-59cd-4b3e-9add-e2dbfa1587f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Volume 2d3686ad-37e0-4110-a222-4f0c63f535cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3686ad-37e0-4110-a222-4f0c63f535cd', 'volume_size': 1} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-504899845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3686ad-37e0-4110-a222-4f0c63f535cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Creating volume 2d3686ad-37e0-4110-a222-4f0c63f535cd {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:31 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:31 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd 1073741824 Feb 24 11:09:31 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Flow 'volume_create_manager' (ea372fcd-efe0-4439-8cff-3ab2ec577804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cfa319-c5a9-4323-97c4-601d7f9e9816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cfa319-c5a9-4323-97c4-601d7f9e9816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-376784748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc11fbac-eba1-4247-bc71-6be4d6190548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0713cf10cee4b60bdc720ef246c1229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='94fd05abfdd64d19ae4baccfcdd3924d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e14788b-4ccf-4e74-a405-37d584c85200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e14788b-4ccf-4e74-a405-37d584c85200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d5ab24-fbac-41b6-bc53-1fe190bfa6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d5ab24-fbac-41b6-bc53-1fe190bfa6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc11fbac-eba1-4247-bc71-6be4d6190548', 'volume_name': 'volume-cc11fbac-eba1-4247-bc71-6be4d6190548', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b500a2-2f47-4797-b08c-0d5bc535bd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b500a2-2f47-4797-b08c-0d5bc535bd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c647f3-2ab7-4471-80c6-076d40dc1666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:31 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Volume cc11fbac-eba1-4247-bc71-6be4d6190548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc11fbac-eba1-4247-bc71-6be4d6190548', 'volume_size': 1} Feb 24 11:09:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (c8dfd4b2-2264-47bc-b217-0aad302b558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ab75cb-2251-4981-b839-193f4475b7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ab75cb-2251-4981-b839-193f4475b7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-421889539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37379f77-ba45-4425-a902-df7cf68ac2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b567e52a-55bd-4753-a591-dfb2ef7cec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b567e52a-55bd-4753-a591-dfb2ef7cec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76862361-9ca2-418b-9894-e50d0fbf41d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76862361-9ca2-418b-9894-e50d0fbf41d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37379f77-ba45-4425-a902-df7cf68ac2b0', 'volume_name': 'volume-37379f77-ba45-4425-a902-df7cf68ac2b0', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4b6833-f268-4041-9936-6902fb4ec994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4b6833-f268-4041-9936-6902fb4ec994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9407d62-9f0d-42c9-a25a-c678d509d935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Volume 37379f77-ba45-4425-a902-df7cf68ac2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37379f77-ba45-4425-a902-df7cf68ac2b0', 'volume_size': 1} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (c97ae225-b475-41fe-a43d-238c4d00e7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b4a8de-c4f2-4f60-ba35-90f0d681d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b4a8de-c4f2-4f60-ba35-90f0d681d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648377940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649ae679-2c91-406e-a153-834209a63a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2956294f-fb51-412e-bb1f-6290682c11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2956294f-fb51-412e-bb1f-6290682c11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f48d6bf-acad-4722-ae4e-45b71ab4e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f48d6bf-acad-4722-ae4e-45b71ab4e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649ae679-2c91-406e-a153-834209a63a5a', 'volume_name': 'volume-649ae679-2c91-406e-a153-834209a63a5a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4fb13d-d8ed-4686-aebc-c111df112c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4fb13d-d8ed-4686-aebc-c111df112c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a037830-2588-430a-a9ee-135db4aed2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume 649ae679-2c91-406e-a153-834209a63a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649ae679-2c91-406e-a153-834209a63a5a', 'volume_size': 1} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (54efc7e3-5a7b-438e-88c7-a8b0cebd3b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c144c1f6-bd01-41ef-abcb-3a412a9b3124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c144c1f6-bd01-41ef-abcb-3a412a9b3124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863815275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5adbc6-e42f-4235-979e-28c3b47e23ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daed43a2-c4dc-40e7-a19d-498cd8bcc189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daed43a2-c4dc-40e7-a19d-498cd8bcc189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e736c6cd-e695-4a5b-aad7-f29523fbd244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e736c6cd-e695-4a5b-aad7-f29523fbd244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5adbc6-e42f-4235-979e-28c3b47e23ac', 'volume_name': 'volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c83e39d-f151-4916-ad68-0def8af6c042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c83e39d-f151-4916-ad68-0def8af6c042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbcbfb4-c80c-4fd9-8c8c-171f7626b409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Volume 0b5adbc6-e42f-4235-979e-28c3b47e23ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac', 'volume_size': 1} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (6acb8186-f1a1-4860-8320-906eb54d21fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983d1088-343c-413a-807f-d7ffebe32836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd 1073741824" returned: 0 in 0.832s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983d1088-343c-413a-807f-d7ffebe32836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2004617085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d40143-143f-4fb1-8fcb-eccbcea9b961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:33Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e97cb5c-477d-4d70-91f0-4024df62e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e97cb5c-477d-4d70-91f0-4024df62e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0adab9-16ed-40e1-8a85-2413fe1842b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0adab9-16ed-40e1-8a85-2413fe1842b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d40143-143f-4fb1-8fcb-eccbcea9b961', 'volume_name': 'volume-36d40143-143f-4fb1-8fcb-eccbcea9b961', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32a76c4-bf65-4777-b03e-4eae693f990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32a76c4-bf65-4777-b03e-4eae693f990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3916588a-4643-4c15-9a39-ff300de6bdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Volume 36d40143-143f-4fb1-8fcb-eccbcea9b961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d40143-143f-4fb1-8fcb-eccbcea9b961', 'volume_size': 1} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:32 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd Feb 24 11:09:32 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (7b718acf-f377-47a4-a47c-f04998e37024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15f633d-2ab1-4b08-b8e0-88eb9fdfa224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15f633d-2ab1-4b08-b8e0-88eb9fdfa224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635601279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b4c91e-b3f0-44c9-b942-55c75a4c2d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:33Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0e1559-d247-4105-b71a-5e429c8c9cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0e1559-d247-4105-b71a-5e429c8c9cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1604adf4-b87e-4192-b3ea-92fe84299a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1604adf4-b87e-4192-b3ea-92fe84299a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b4c91e-b3f0-44c9-b942-55c75a4c2d3a', 'volume_name': 'volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6ef9da-5e37-4731-a570-07ffed7cdb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6ef9da-5e37-4731-a570-07ffed7cdb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8eebe1-e118-439c-b815-6ceea3ab91a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:32 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Volume 37b4c91e-b3f0-44c9-b942-55c75a4c2d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a', 'volume_size': 1} Feb 24 11:09:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:33 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd" returned: 0 in 0.424s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-376784748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc11fbac-eba1-4247-bc71-6be4d6190548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0713cf10cee4b60bdc720ef246c1229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='94fd05abfdd64d19ae4baccfcdd3924d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Creating volume cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:33 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b803d5-59cd-4b3e-9add-e2dbfa1587f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3686ad-37e0-4110-a222-4f0c63f535cd', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa3a03b-dba3-41b5-ae1d-ce00b7f59b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:33 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 1073741824 Feb 24 11:09:33 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:33 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Volume volume-2d3686ad-37e0-4110-a222-4f0c63f535cd (2d3686ad-37e0-4110-a222-4f0c63f535cd): created successfully Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa3a03b-dba3-41b5-ae1d-ce00b7f59b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (bcaae1d5-b3cd-4264-a10e-b6dace83119c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-88c8b75c-633a-47e8-a687-1996c368d852 tempest-CreateVolumesFromImageTest-1175591173 None] Created volume successfully. Feb 24 11:09:33 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 1073741824" returned: 0 in 0.552s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:33 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 Feb 24 11:09:33 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:34 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:34 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:34 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548" returned: 0 in 0.464s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.996s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-421889539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37379f77-ba45-4425-a902-df7cf68ac2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Creating volume 37379f77-ba45-4425-a902-df7cf68ac2b0 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:34 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c647f3-2ab7-4471-80c6-076d40dc1666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc11fbac-eba1-4247-bc71-6be4d6190548', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7e75ed-e3af-4571-896f-3c2853d966e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:34 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 1073741824 Feb 24 11:09:34 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:34 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Volume volume-cc11fbac-eba1-4247-bc71-6be4d6190548 (cc11fbac-eba1-4247-bc71-6be4d6190548): created successfully Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7e75ed-e3af-4571-896f-3c2853d966e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Flow 'volume_create_manager' (ea372fcd-efe0-4439-8cff-3ab2ec577804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-051e3218-3102-4fcd-a0bc-ee35062d71e4 tempest-VolumeDependencyTests-1203560447 None] Created volume successfully. Feb 24 11:09:34 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.474s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:34 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 1073741824" returned: 0 in 0.479s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:34 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 Feb 24 11:09:34 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:35 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0" returned: 0 in 0.518s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.947s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648377940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649ae679-2c91-406e-a153-834209a63a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Creating volume 649ae679-2c91-406e-a153-834209a63a5a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:35 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9407d62-9f0d-42c9-a25a-c678d509d935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37379f77-ba45-4425-a902-df7cf68ac2b0', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:35 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a 1073741824 Feb 24 11:09:35 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea8d78e-9490-41a9-b49f-6d789c36f0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:35 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Volume volume-37379f77-ba45-4425-a902-df7cf68ac2b0 (37379f77-ba45-4425-a902-df7cf68ac2b0): created successfully Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea8d78e-9490-41a9-b49f-6d789c36f0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (c8dfd4b2-2264-47bc-b217-0aad302b558f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:35 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b9a8b586-811a-48d1-b149-80e7374d187f tempest-CreateVolumesFromImageTest-1175591173 None] Created volume successfully. Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:35 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a 1073741824" returned: 0 in 0.512s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:35 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:35 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a Feb 24 11:09:35 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:36 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a" returned: 0 in 0.455s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.785s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863815275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5adbc6-e42f-4235-979e-28c3b47e23ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:32Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Creating volume 0b5adbc6-e42f-4235-979e-28c3b47e23ac {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:36 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a037830-2588-430a-a9ee-135db4aed2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649ae679-2c91-406e-a153-834209a63a5a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba39a5b-72a7-4aa2-a15a-e517063c2da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:36 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume volume-649ae679-2c91-406e-a153-834209a63a5a (649ae679-2c91-406e-a153-834209a63a5a): created successfully Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba39a5b-72a7-4aa2-a15a-e517063c2da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:36 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac 1073741824 Feb 24 11:09:36 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (c97ae225-b475-41fe-a43d-238c4d00e7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:36 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-711b35b2-a825-4fe1-af07-b1e1f56eeec4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created volume successfully. Feb 24 11:09:36 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac 1073741824" returned: 0 in 0.567s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:36 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:36 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac Feb 24 11:09:36 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:37 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac" returned: 0 in 0.406s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.532s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2004617085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d40143-143f-4fb1-8fcb-eccbcea9b961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:33Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Creating volume 36d40143-143f-4fb1-8fcb-eccbcea9b961 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:37 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbcbfb4-c80c-4fd9-8c8c-171f7626b409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39972fe0-5efb-45aa-895b-3c99c31ae547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:37 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Volume volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac (0b5adbc6-e42f-4235-979e-28c3b47e23ac): created successfully Feb 24 11:09:37 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 1073741824 Feb 24 11:09:37 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39972fe0-5efb-45aa-895b-3c99c31ae547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (54efc7e3-5a7b-438e-88c7-a8b0cebd3b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:37 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-2f8329a9-7696-4ab2-8fbc-f9e75d2cd079 tempest-CreateVolumesFromImageTest-1175591173 None] Created volume successfully. Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:37 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 1073741824" returned: 0 in 0.531s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:37 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:37 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 Feb 24 11:09:37 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:38 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961" returned: 0 in 0.442s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.352s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635601279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b4c91e-b3f0-44c9-b942-55c75a4c2d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f3dcb685d5440fa92d081dc1e70d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:33Z,use_quota=True,user_id='20b4706ed9a14ba5ab72b425e1b0b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Creating volume 37b4c91e-b3f0-44c9-b942-55c75a4c2d3a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:38 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3916588a-4643-4c15-9a39-ff300de6bdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d40143-143f-4fb1-8fcb-eccbcea9b961', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:38 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a 1073741824 Feb 24 11:09:38 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877ed737-6619-4682-863d-292ec90ecf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:38 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Volume volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 (36d40143-143f-4fb1-8fcb-eccbcea9b961): created successfully Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877ed737-6619-4682-863d-292ec90ecf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (6acb8186-f1a1-4860-8320-906eb54d21fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:38 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-e29f14be-e8cf-4247-8d5b-612651f1e61e tempest-CreateVolumesFromImageTest-1175591173 None] Created volume successfully. Feb 24 11:09:38 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a 1073741824" returned: 0 in 0.510s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:38 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:38 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a Feb 24 11:09:38 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:39 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a" returned: 0 in 0.524s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.951s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8eebe1-e118-439c-b815-6ceea3ab91a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91d5ec3-39b3-4fde-9d40-35d00e0d7d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Creating offline snapshot 126a7d5c-fc2f-4c29-8203-df8efa54000a of volume cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:09:39 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Volume volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a (37b4c91e-b3f0-44c9-b942-55c75a4c2d3a): created successfully Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91d5ec3-39b3-4fde-9d40-35d00e0d7d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Flow 'volume_create_manager' (7b718acf-f377-47a4-a47c-f04998e37024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c23e5a-6003-4af7-a2cd-1a62888047c4]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:39 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-548773a5-3359-4037-80a2-b3c43399ef54 tempest-CreateVolumesFromImageTest-1175591173 None] Created volume successfully. Feb 24 11:09:39 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 Feb 24 11:09:39 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:39 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548" returned: 0 in 0.538s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:39 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:39 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a 1G Feb 24 11:09:39 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:40 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a 1G" returned: 0 in 0.494s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc11fbac-eba1-4247-bc71-6be4d6190548 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:40 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc11fbac-eba1-4247-bc71-6be4d6190548 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:40 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-quobyte-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ce3959-d8f1-4730-9bac-2b53ca5cc6e4]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:40 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a Feb 24 11:09:40 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:40 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc11fbac-eba1-4247-bc71-6be4d6190548 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a" returned: 0 in 0.480s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:40 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a is being set with open permissions: ugo+rw Feb 24 11:09:40 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:40 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a Feb 24 11:09:40 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:41 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a" returned: 0 in 0.557s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:41 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a Feb 24 11:09:41 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:41 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a" returned: 0 in 0.422s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:41 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.info Feb 24 11:09:41 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:41 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a" returned: 0 in 0.423s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a" released by "delete_volume" :: held 1.013s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Created reservations ['f9b1a864-6fc2-412c-a4d7-6527a63dfdaf', 'ec782262-8d1b-4817-befd-ba06ea498328', '16b2a2bd-5e27-4a39-9349-f0ea86c4a751', '4af7a733-7f8a-439e-b018-168023b2a8cc'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:41 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:41 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:41 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.info" returned: 0 in 0.462s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:41 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.info is being set with open permissions: ugo+rw Feb 24 11:09:41 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:41 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.info Feb 24 11:09:41 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:42 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.461s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:42 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Deleted volume successfully. Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1e9ff2ed-0da2-4712-b8f8-01f594495a8c tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-37b4c91e-b3f0-44c9-b942-55c75a4c2d3a-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:42 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.info" returned: 0 in 0.402s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.888s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.693s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Creating offline snapshot 2813874e-5e37-461d-8c83-637a5b9b90f2 of volume 649ae679-2c91-406e-a153-834209a63a5a {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:09:42 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-26b6a1c7-ab7a-4a96-bb64-e7166aaf035c tempest-VolumeDependencyTests-1203560447 None] Create snapshot completed successfully Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8fe42f-ea00-47a3-883b-10d22e9646b7]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:42 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a Feb 24 11:09:42 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-36d40143-143f-4fb1-8fcb-eccbcea9b961-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-36d40143-143f-4fb1-8fcb-eccbcea9b961-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-quobyte-36d40143-143f-4fb1-8fcb-eccbcea9b961" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-36d40143-143f-4fb1-8fcb-eccbcea9b961" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff42b5-dd1d-4e29-9c34-0f2f47163d30]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:42 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:42 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 Feb 24 11:09:42 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a" returned: 0 in 0.668s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:42 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:43 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 1G Feb 24 11:09:43 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Flow 'volume_create_manager' (d8b96019-464a-490d-b14b-9bf8dc13107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f82f51-e66f-422d-9e43-07d6011fec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f82f51-e66f-422d-9e43-07d6011fec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-395896026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409352fd-a8d3-48d9-a1a5-d736aeb6b35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0713cf10cee4b60bdc720ef246c1229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=126a7d5c-fc2f-4c29-8203-df8efa54000a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:43Z,use_quota=True,user_id='94fd05abfdd64d19ae4baccfcdd3924d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1b71c5-0b32-46c3-ad74-c0892a151103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1b71c5-0b32-46c3-ad74-c0892a151103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e796df77-e843-4d13-baff-f64b11e95d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e796df77-e843-4d13-baff-f64b11e95d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '409352fd-a8d3-48d9-a1a5-d736aeb6b35d', 'volume_name': 'volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d', 'volume_size': 1, 'snapshot_id': '126a7d5c-fc2f-4c29-8203-df8efa54000a'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb69747-efa9-478e-83f8-0007cbe65207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb69747-efa9-478e-83f8-0007cbe65207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bda4f8b-40a0-42f9-b71f-7f00ce5833a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:43 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Volume 409352fd-a8d3-48d9-a1a5-d736aeb6b35d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d', 'volume_size': 1, 'snapshot_id': '126a7d5c-fc2f-4c29-8203-df8efa54000a'} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:43 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 1G" returned: 0 in 0.487s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649ae679-2c91-406e-a153-834209a63a5a -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:43 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961" returned: 0 in 0.696s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:43 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:43 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649ae679-2c91-406e-a153-834209a63a5a -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 Feb 24 11:09:43 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:43 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961 Feb 24 11:09:43 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:44 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-36d40143-143f-4fb1-8fcb-eccbcea9b961" returned: 0 in 0.534s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-36d40143-143f-4fb1-8fcb-eccbcea9b961" released by "delete_volume" :: held 1.254s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Created reservations ['b4cfdd94-ebbd-45ba-8151-e38def3161cf', 'f2a2ec1b-4458-4c65-81e4-f10138a42bcc', '79409433-d010-4986-81f5-07db53ec0f6f', '212899b6-f4c8-4149-8e31-f2afded1429c'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:44 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649ae679-2c91-406e-a153-834209a63a5a -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2" returned: 0 in 0.627s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:44 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 is being set with open permissions: ugo+rw Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:44 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:44 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:44 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:44 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:44 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2" returned: 0 in 0.458s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:44 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.info Feb 24 11:09:44 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:44 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.507s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:44 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Deleted volume successfully. Feb 24 11:09:44 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-56882101-c544-4525-8dd1-6d1aa012d641 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-36d40143-143f-4fb1-8fcb-eccbcea9b961-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-0b5adbc6-e42f-4235-979e-28c3b47e23ac-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-0b5adbc6-e42f-4235-979e-28c3b47e23ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-quobyte-0b5adbc6-e42f-4235-979e-28c3b47e23ac" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:45 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.info" returned: 0 in 0.503s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:45 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.info is being set with open permissions: ugo+rw Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-0b5adbc6-e42f-4235-979e-28c3b47e23ac" acquired by "delete_volume" :: waited 0.030s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:45 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.info Feb 24 11:09:45 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1733b4-2464-47da-85db-64bc34da30e8]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:45 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac Feb 24 11:09:45 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:45 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.info" returned: 0 in 0.572s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.411s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.566s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-126a7d5c-fc2f-4c29-8203-df8efa54000a-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" by "_create_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:45 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-b76805cf-d816-444f-b67c-71561048928d tempest-CreateVolumesFromSnapshotTest-1888504184 None] Create snapshot completed successfully Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-126a7d5c-fc2f-4c29-8203-df8efa54000a-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" acquired by "_create_volume_from_snapshot" :: waited 0.061s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Creating volume 409352fd-a8d3-48d9-a1a5-d736aeb6b35d from snapshot 126a7d5c-fc2f-4c29-8203-df8efa54000a {{(pid=82627) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] snapshot: 126a7d5c-fc2f-4c29-8203-df8efa54000a, volume: 409352fd-a8d3-48d9-a1a5-d736aeb6b35d, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:09:45 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac" returned: 0 in 0.695s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[64926bc0-4522-4a14-9675-121d0ee6e019]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:45 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:45 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac Feb 24 11:09:45 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:45 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a Feb 24 11:09:45 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (4747d095-0e9e-4e33-94b6-33e69ca21b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468ac37b-54de-4566-8aac-d0670aca58ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468ac37b-54de-4566-8aac-d0670aca58ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-886723449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:46Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77750b0-5103-4239-a6c2-fca1d91dcaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77750b0-5103-4239-a6c2-fca1d91dcaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd5e98f-9137-47bd-bee2-4c04fe5575ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd5e98f-9137-47bd-bee2-4c04fe5575ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6', 'volume_name': 'volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c161dddf-7517-4264-bce1-da7ece9fc0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c161dddf-7517-4264-bce1-da7ece9fc0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5118edfc-1718-4d40-aa2f-9659f19bb452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume 91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6', 'volume_size': 1} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:46 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-0b5adbc6-e42f-4235-979e-28c3b47e23ac" returned: 0 in 0.650s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (afe308ff-91d4-4bbf-90d3-31aba1f15469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e88fecb-8078-44b0-bb0e-877b5ae63c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-0b5adbc6-e42f-4235-979e-28c3b47e23ac" released by "delete_volume" :: held 1.404s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e88fecb-8078-44b0-bb0e-877b5ae63c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91100632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:46Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b769437-0043-4d99-aa51-adfc2389ecf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b769437-0043-4d99-aa51-adfc2389ecf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bfeab8-3e74-4f99-99b0-269eeb3fe317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bfeab8-3e74-4f99-99b0-269eeb3fe317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680', 'volume_name': 'volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61eb727-5f1c-42b5-bd30-d19441223a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61eb727-5f1c-42b5-bd30-d19441223a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee7802f-1544-448a-a04e-8fa0a83f70ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680', 'volume_size': 1} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a" returned: 0 in 0.737s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc11fbac-eba1-4247-bc71-6be4d6190548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c04c6f0-b36b-4416-8955-7653a81d966f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Created reservations ['11ea2884-b9aa-425e-948f-8970be92b852', '2428231f-177c-4b53-8bab-58cd494ebccf', '2723e5d1-4fa6-4cca-a3c3-d79d8930bfd5', '401bd8bc-92a4-45d5-bbf4-a9f84dd16047'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (18f765ba-88b4-4329-b56c-9b27eb9e03d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96432923-90c7-41aa-aef8-1297af459f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96432923-90c7-41aa-aef8-1297af459f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283797295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9baa96-4c39-42de-875a-3d82d2cc8654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:47Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc7aaf7-11eb-4357-a7ac-09c859e18164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 Feb 24 11:09:46 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc7aaf7-11eb-4357-a7ac-09c859e18164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c74a8d-6d55-47e6-a57e-e10e82d3dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c74a8d-6d55-47e6-a57e-e10e82d3dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9baa96-4c39-42de-875a-3d82d2cc8654', 'volume_name': 'volume-fd9baa96-4c39-42de-875a-3d82d2cc8654', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1520c9-1582-40fe-81d5-06f85b416ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1520c9-1582-40fe-81d5-06f85b416ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9272ef77-6ddf-4180-bec8-46d2b03708fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:46 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume fd9baa96-4c39-42de-875a-3d82d2cc8654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9baa96-4c39-42de-875a-3d82d2cc8654', 'volume_size': 1} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:46 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:46 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:46 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Flow 'volume_create_manager' (528844dd-4225-45f6-a0e0-5318f97079ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148ea498-1fd5-41dc-8f45-1a361bf532a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148ea498-1fd5-41dc-8f45-1a361bf532a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-323759188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be0a03c-bb29-4cdf-ad44-0a360a127a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257a89e0716a4d4fb498471eeb632080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:47Z,use_quota=True,user_id='9ee3effe33de475d9474301cc05dfae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8a3e15-69a7-4638-9974-f8f0d4ac3782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8a3e15-69a7-4638-9974-f8f0d4ac3782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f38227-cf1d-44e7-94e4-fac1e4e3f2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f38227-cf1d-44e7-94e4-fac1e4e3f2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be0a03c-bb29-4cdf-ad44-0a360a127a2e', 'volume_name': 'volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77f57d7-cfe1-44ee-8422-0f206e7bb6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77f57d7-cfe1-44ee-8422-0f206e7bb6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d857a4-1dbd-4d42-a6b7-c563cebff7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Volume 1be0a03c-bb29-4cdf-ad44-0a360a127a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e', 'volume_size': 1} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (d16bef5c-cc8e-456b-a8a9-f64d40ec5545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2d85cd-ec81-45b5-8aba-8f2246a02a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548" returned: 0 in 0.638s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2d85cd-ec81-45b5-8aba-8f2246a02a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375153537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fc7504-a5a3-4175-ad63-c8a2de52fa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:47Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23d7d81-a85c-4443-9487-22ee1464907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23d7d81-a85c-4443-9487-22ee1464907a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e13d65b-bb07-482f-b885-b53f7c9fedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e13d65b-bb07-482f-b885-b53f7c9fedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18fc7504-a5a3-4175-ad63-c8a2de52fa52', 'volume_name': 'volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3035d473-53c5-47ab-abda-6afd1a7bd032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3035d473-53c5-47ab-abda-6afd1a7bd032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c150825-035f-4fbc-b126-4a22e8b55540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume 18fc7504-a5a3-4175-ad63-c8a2de52fa52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52', 'volume_size': 1} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-37379f77-ba45-4425-a902-df7cf68ac2b0-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:47 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d Feb 24 11:09:47 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (0b8e647d-8cdd-41c8-a877-52d60762fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578ee9c9-19b2-4aab-8f4d-c84ab3bfbbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578ee9c9-19b2-4aab-8f4d-c84ab3bfbbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-351247396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513c4d2-87ad-4380-a3ae-3d65655b31f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:47Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1996e2b-3194-4100-9888-506f2bf6c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1996e2b-3194-4100-9888-506f2bf6c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8361618e-4930-426d-acf2-5d0a17bd6eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8361618e-4930-426d-acf2-5d0a17bd6eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c513c4d2-87ad-4380-a3ae-3d65655b31f5', 'volume_name': 'volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f123c07-e345-438d-81fe-c67bcba1e278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f123c07-e345-438d-81fe-c67bcba1e278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f31edb7-942f-4ab1-b771-1898ed721a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:47 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume c513c4d2-87ad-4380-a3ae-3d65655b31f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5', 'volume_size': 1} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-37379f77-ba45-4425-a902-df7cf68ac2b0-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.592s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:47 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Deleted volume successfully. Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-13f7c931-ef31-468b-8e5b-2b42fee73bc7 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-0b5adbc6-e42f-4235-979e-28c3b47e23ac-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-quobyte-37379f77-ba45-4425-a902-df7cf68ac2b0" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-37379f77-ba45-4425-a902-df7cf68ac2b0" acquired by "delete_volume" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5918f931-987c-412f-b02f-d5a91bcb80e9]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:47 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:47 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 Feb 24 11:09:47 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:48 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0" returned: 0 in 1.012s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:48 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:48 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0 Feb 24 11:09:48 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:49 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-37379f77-ba45-4425-a902-df7cf68ac2b0" returned: 0 in 0.953s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-37379f77-ba45-4425-a902-df7cf68ac2b0" released by "delete_volume" :: held 1.996s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Created reservations ['2adb158d-d095-4c84-8077-26575be692e3', '0b4029fb-e131-416c-a6c9-575c8442f8d7', '51e593c8-61fc-42e2-b89a-bbccfe0ccdad', '2d853322-8eae-4feb-9531-20673e20c1ba'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:49 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" returned: 0 in 2.227s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ae8d88-ec9b-43d3-8d8e-32cd3a40ff07]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:49 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:49 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-2d3686ad-37e0-4110-a222-4f0c63f535cd-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-2d3686ad-37e0-4110-a222-4f0c63f535cd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "cinder-quobyte-2d3686ad-37e0-4110-a222-4f0c63f535cd" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:49 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 Feb 24 11:09:49 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-2d3686ad-37e0-4110-a222-4f0c63f535cd" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[860368f4-bb38-4fa1-bf83-f32f09ae9f70]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:49 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd Feb 24 11:09:49 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:49 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.419s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:49 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Deleted volume successfully. Feb 24 11:09:49 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-89c9b940-5339-47fb-b73f-f741524ffbf0 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-37379f77-ba45-4425-a902-df7cf68ac2b0-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:50 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd" returned: 0 in 0.510s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:50 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548" returned: 0 in 0.648s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:09:50 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Converted 1024.00 MB image at 459.67 MB/s Feb 24 11:09:50 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d is being set with open permissions: ugo+rw Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:50 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd Feb 24 11:09:50 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:50 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d Feb 24 11:09:50 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:50 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-2d3686ad-37e0-4110-a222-4f0c63f535cd" returned: 0 in 0.439s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-quobyte-2d3686ad-37e0-4110-a222-4f0c63f535cd" released by "delete_volume" :: held 0.974s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:50 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" returned: 0 in 0.445s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" released by "_copy_volume_from_snapshot" :: held 4.842s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-126a7d5c-fc2f-4c29-8203-df8efa54000a-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" released by "_create_volume_from_snapshot" :: held 4.879s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.942s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.221s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-886723449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:46Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Creating volume 91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:50 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:50 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 1073741824 Feb 24 11:09:50 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bda4f8b-40a0-42f9-b71f-7f00ce5833a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d', 'volume_size': 1, 'snapshot_id': '126a7d5c-fc2f-4c29-8203-df8efa54000a'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c9fcfc-3622-4758-80f0-03394ad734ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Created reservations ['04ad553c-b86c-4b3c-ba1b-be9e005b7922', '0389c462-b04b-4d6b-bafa-ae079e6d12db', '0ca2a0f3-421e-466e-b34c-57558038708b', 'a05786c5-0550-4438-935a-e3497c5406f4'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:50 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Volume volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d (409352fd-a8d3-48d9-a1a5-d736aeb6b35d): created successfully Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c9fcfc-3622-4758-80f0-03394ad734ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Flow 'volume_create_manager' (d8b96019-464a-490d-b14b-9bf8dc13107d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:50 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7736fdf1-b91a-4c93-bb77-37718b29c0c2 tempest-VolumeDependencyTests-1203560447 None] Created volume successfully. Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:50 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:50 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:50 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:51 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 1073741824" returned: 0 in 0.497s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:51 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.431s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:51 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Deleted volume successfully. Feb 24 11:09:51 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 Feb 24 11:09:51 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-bbfa7a3c-d96a-4e68-951f-0107f5e6df63 tempest-CreateVolumesFromImageTest-1175591173 None] Lock "cinder-2d3686ad-37e0-4110-a222-4f0c63f535cd-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-126a7d5c-fc2f-4c29-8203-df8efa54000a-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-126a7d5c-fc2f-4c29-8203-df8efa54000a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-cc11fbac-eba1-4247-bc71-6be4d6190548" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-cc11fbac-eba1-4247-bc71-6be4d6190548" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-126a7d5c-fc2f-4c29-8203-df8efa54000a" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:51 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-126a7d5c-fc2f-4c29-8203-df8efa54000a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Deleting offline snapshot 126a7d5c-fc2f-4c29-8203-df8efa54000a of volume cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] snapshot_file for this snap is: volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6" returned: 0 in 0.513s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be676d4-c651-4d0c-9a0e-832e8eec5127]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.129s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91100632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:46Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Creating volume e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:51 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:51 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 1073741824 Feb 24 11:09:51 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5118edfc-1718-4d40-aa2f-9659f19bb452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b71af0-6e47-437e-8f7a-6acca663f0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:51 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 (91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6): created successfully Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b71af0-6e47-437e-8f7a-6acca663f0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:51 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (4747d095-0e9e-4e33-94b6-33e69ca21b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:51 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-aa9d9dda-918d-4ec9-8328-a3d89b747a66 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created volume successfully. Feb 24 11:09:51 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a Feb 24 11:09:51 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:52 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 1073741824" returned: 0 in 0.485s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:52 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 Feb 24 11:09:52 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:52 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a" returned: 0 in 0.590s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc11fbac-eba1-4247-bc71-6be4d6190548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fa0b27-d354-42a5-b3a0-02964a51c83d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:52 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 Feb 24 11:09:52 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:52 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680" returned: 0 in 0.599s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.055s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283797295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9baa96-4c39-42de-875a-3d82d2cc8654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:47Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Creating volume fd9baa96-4c39-42de-875a-3d82d2cc8654 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:52 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:52 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee7802f-1544-448a-a04e-8fa0a83f70ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae253e03-094b-4808-9c2d-e792e33a04ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:52 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 1073741824 Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548" returned: 0 in 0.549s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:52 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:52 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 (e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680): created successfully Feb 24 11:09:52 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae253e03-094b-4808-9c2d-e792e33a04ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:52 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:52 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (afe308ff-91d4-4bbf-90d3-31aba1f15469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:52 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7fb900c5-6f06-4a8a-b1cc-607afd420de4 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created volume successfully. Feb 24 11:09:53 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 1073741824" returned: 0 in 0.544s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:53 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a" returned: 0 in 0.547s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:53 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 Feb 24 11:09:53 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:53 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a Feb 24 11:09:53 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (f7d5b9d9-1557-4d55-89a0-7d9035a53cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f4ee01-2b79-4872-a747-f55870b3c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f4ee01-2b79-4872-a747-f55870b3c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177780652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5cfa12-5516-4087-ad20-72938db798b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:54Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d7e18d-bcf1-4caa-bb92-97f1666fa8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d7e18d-bcf1-4caa-bb92-97f1666fa8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ea539f-7aee-4ffc-a458-64a49001302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ea539f-7aee-4ffc-a458-64a49001302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5cfa12-5516-4087-ad20-72938db798b9', 'volume_name': 'volume-7b5cfa12-5516-4087-ad20-72938db798b9', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c39c9f-7b4a-491a-a66f-067f37eeab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c39c9f-7b4a-491a-a66f-067f37eeab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac649354-a524-4fc2-8b26-bce86bec56c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:53 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume 7b5cfa12-5516-4087-ad20-72938db798b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5cfa12-5516-4087-ad20-72938db798b9', 'volume_size': 1} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:53 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654" returned: 0 in 0.466s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.738s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-323759188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be0a03c-bb29-4cdf-ad44-0a360a127a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257a89e0716a4d4fb498471eeb632080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:47Z,use_quota=True,user_id='9ee3effe33de475d9474301cc05dfae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Creating volume 1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:53 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:53 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548.126a7d5c-fc2f-4c29-8203-df8efa54000a" returned: 0 in 0.467s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:53 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e 1073741824 Feb 24 11:09:53 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9272ef77-6ddf-4180-bec8-46d2b03708fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9baa96-4c39-42de-875a-3d82d2cc8654', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef26b0e-382f-447e-a0b7-a71882d67281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-126a7d5c-fc2f-4c29-8203-df8efa54000a" released by "_delete_snapshot" :: held 2.264s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-cc11fbac-eba1-4247-bc71-6be4d6190548" released by "delete_snapshot" :: held 2.285s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:53 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 (fd9baa96-4c39-42de-875a-3d82d2cc8654): created successfully Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef26b0e-382f-447e-a0b7-a71882d67281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:53 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (18f765ba-88b4-4329-b56c-9b27eb9e03d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:53 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7ae22ee4-3e35-40e1-b6c5-bd3479e1571c tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created volume successfully. Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Created reservations ['c38f7b74-e450-4200-a19c-884c780a3d4a', 'f2e65306-8712-45d4-bb40-9d34f414a942', '7f743038-7445-46fb-81f0-0f3be5e00414', '2915be17-4e13-45d7-b223-049ae0b9a41b'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Delete snapshot completed successfully. Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-dc6389ca-f7db-468a-9acf-cc2eff0949e0 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-126a7d5c-fc2f-4c29-8203-df8efa54000a-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:54 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e 1073741824" returned: 0 in 0.497s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:54 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e Feb 24 11:09:54 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-cc11fbac-eba1-4247-bc71-6be4d6190548-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-cc11fbac-eba1-4247-bc71-6be4d6190548-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:54 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" returned: 0 in 0.431s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.571s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375153537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fc7504-a5a3-4175-ad63-c8a2de52fa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:47Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Creating volume 18fc7504-a5a3-4175-ad63-c8a2de52fa52 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:54 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:54 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 1073741824 Feb 24 11:09:54 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d857a4-1dbd-4d42-a6b7-c563cebff7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd5486d-cf6b-4fe5-ba22-629047fcf1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:54 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Volume volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e (1be0a03c-bb29-4cdf-ad44-0a360a127a2e): created successfully Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd5486d-cf6b-4fe5-ba22-629047fcf1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Flow 'volume_create_manager' (528844dd-4225-45f6-a0e0-5318f97079ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-cc11fbac-eba1-4247-bc71-6be4d6190548" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:54 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-ea011f44-c2df-4a12-8849-e56f0f381150 tempest-SnapshotDependencyTests-317989621 None] Created volume successfully. Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-cc11fbac-eba1-4247-bc71-6be4d6190548" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[274e59ef-6bee-4962-841b-4f1934e56757]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:54 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:55 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 Feb 24 11:09:55 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:55 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 1073741824" returned: 0 in 0.485s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:55 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 Feb 24 11:09:55 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:55 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548" returned: 0 in 0.500s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:55 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548 Feb 24 11:09:55 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:55 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52" returned: 0 in 0.448s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.426s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-351247396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513c4d2-87ad-4380-a3ae-3d65655b31f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8522002e85f04e6cb4af5081ec3a1021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:47Z,use_quota=True,user_id='20d32d2946bc4d188199bc91393d10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Creating volume c513c4d2-87ad-4380-a3ae-3d65655b31f5 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:55 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c150825-035f-4fbc-b126-4a22e8b55540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f454f9fd-47de-40e1-9237-c972c852eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:55 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 1073741824 Feb 24 11:09:55 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:55 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 (18fc7504-a5a3-4175-ad63-c8a2de52fa52): created successfully Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f454f9fd-47de-40e1-9237-c972c852eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (d16bef5c-cc8e-456b-a8a9-f64d40ec5545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:55 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-c2a32566-e5a7-4846-af8d-97eab2f08ecd tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created volume successfully. Feb 24 11:09:55 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-cc11fbac-eba1-4247-bc71-6be4d6190548" returned: 0 in 0.468s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-cc11fbac-eba1-4247-bc71-6be4d6190548" released by "delete_volume" :: held 0.999s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:55 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Created reservations ['3e065f71-0ce8-43ce-b598-63ccace37bb9', 'f4a37609-d976-4982-9d2d-f1271726d2c3', '8af01928-ef38-40bb-a052-436ce397b8ef', 'fd3fd7cb-3d69-433f-935b-bccdd5f20544'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:56 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:56 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:56 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 1073741824" returned: 0 in 0.521s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:56 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 Feb 24 11:09:56 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:56 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.461s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Deleted volume successfully. Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-07a60546-275a-4cea-8ab5-34a7f145c409 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-cc11fbac-eba1-4247-bc71-6be4d6190548-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:56 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5" returned: 0 in 0.428s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.081s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177780652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5cfa12-5516-4087-ad20-72938db798b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:54Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Creating volume 7b5cfa12-5516-4087-ad20-72938db798b9 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:09:56 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f31edb7-942f-4ab1-b771-1898ed721a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:56 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 1073741824 Feb 24 11:09:56 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2948957-516c-46d4-bbb7-1d330afe4423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:56 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Volume volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 (c513c4d2-87ad-4380-a3ae-3d65655b31f5): created successfully Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2948957-516c-46d4-bbb7-1d330afe4423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:56 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Flow 'volume_create_manager' (0b8e647d-8cdd-41c8-a877-52d60762fd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:56 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-101b9b7c-4d6e-4816-b3ba-3e3428e19637 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created volume successfully. Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-c513c4d2-87ad-4380-a3ae-3d65655b31f5-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-c513c4d2-87ad-4380-a3ae-3d65655b31f5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-quobyte-c513c4d2-87ad-4380-a3ae-3d65655b31f5" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-c513c4d2-87ad-4380-a3ae-3d65655b31f5" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[11be26a1-4ee8-45ec-853f-45561cc9010f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:57 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 Feb 24 11:09:57 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Flow 'volume_create_manager' (e453936f-1eb5-47ee-b0ca-0ce037987b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e6f1cd-2ebc-430f-a1f5-e8d4be310a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e6f1cd-2ebc-430f-a1f5-e8d4be310a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468509343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad00396-fd84-4bad-8455-9c2590b7b064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0713cf10cee4b60bdc720ef246c1229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:57Z,use_quota=True,user_id='94fd05abfdd64d19ae4baccfcdd3924d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d5d248-94ab-4618-94bc-10ac26373ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d5d248-94ab-4618-94bc-10ac26373ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de8af76-22fe-42a6-bbc5-64e0458adba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de8af76-22fe-42a6-bbc5-64e0458adba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ad00396-fd84-4bad-8455-9c2590b7b064', 'volume_name': 'volume-6ad00396-fd84-4bad-8455-9c2590b7b064', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee77e5e7-040a-411b-b02f-5a5603d19e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee77e5e7-040a-411b-b02f-5a5603d19e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96bfca8-da38-4673-b634-b506aef44289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:57 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Volume 6ad00396-fd84-4bad-8455-9c2590b7b064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ad00396-fd84-4bad-8455-9c2590b7b064', 'volume_size': 1} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:57 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 1073741824" returned: 0 in 0.567s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:57 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 Feb 24 11:09:57 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:57 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5" returned: 0 in 0.540s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:57 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5 Feb 24 11:09:57 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:57 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9" returned: 0 in 0.485s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.142s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Creating offline snapshot a948796b-b2b1-4a8b-91f1-494539bbff01 of volume 1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac649354-a524-4fc2-8b26-bce86bec56c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5cfa12-5516-4087-ad20-72938db798b9', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf103d4b-29c9-443b-95f0-d43ccfe82129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdca655-0ab7-425d-90eb-ce8e7fcfbe97]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:57 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume volume-7b5cfa12-5516-4087-ad20-72938db798b9 (7b5cfa12-5516-4087-ad20-72938db798b9): created successfully Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf103d4b-29c9-443b-95f0-d43ccfe82129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:57 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (f7d5b9d9-1557-4d55-89a0-7d9035a53cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:57 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d8947513-dcd7-463d-aebb-b39ef970b32e tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created volume successfully. Feb 24 11:09:58 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e Feb 24 11:09:58 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:58 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-c513c4d2-87ad-4380-a3ae-3d65655b31f5" returned: 0 in 0.431s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-c513c4d2-87ad-4380-a3ae-3d65655b31f5" released by "delete_volume" :: held 0.998s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created reservations ['72a0d9a1-8cff-46a1-aaee-fc132b4f6f9b', '0133ccd8-daee-4956-b646-e37ac4c886ec', '8494fd04-e567-419c-beb7-5dc956f9a132', '73836a3a-0792-4709-aad9-9b3fe0d213b5'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:58 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:09:58 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:58 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" returned: 0 in 0.471s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:58 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 1G Feb 24 11:09:58 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:58 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.419s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:09:58 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Deleted volume successfully. Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-7bc02cfc-45dd-408c-9d19-13752b8ca1dc tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-c513c4d2-87ad-4380-a3ae-3d65655b31f5-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:09:58 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 1G" returned: 0 in 0.477s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:58 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:58 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 Feb 24 11:09:58 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (515eae34-9d88-423b-9086-9a8c68068d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5678a03e-dbff-4cce-a232-5f4ca4c47573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5678a03e-dbff-4cce-a232-5f4ca4c47573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772281884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7608b45-27b4-42ed-bfee-d55fe68d7e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:59Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657ae10b-c93e-422b-96cd-eaf8726f28d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657ae10b-c93e-422b-96cd-eaf8726f28d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc253696-d46a-46af-a5fb-018362c4779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc253696-d46a-46af-a5fb-018362c4779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7608b45-27b4-42ed-bfee-d55fe68d7e60', 'volume_name': 'volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d013eb-0ed8-4356-bc36-5ea64f093868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d013eb-0ed8-4356-bc36-5ea64f093868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fdbe40-4c2c-4e9f-b3ec-9acf520803f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume e7608b45-27b4-42ed-bfee-d55fe68d7e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60', 'volume_size': 1} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-18fc7504-a5a3-4175-ad63-c8a2de52fa52-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-18fc7504-a5a3-4175-ad63-c8a2de52fa52-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-quobyte-18fc7504-a5a3-4175-ad63-c8a2de52fa52" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-18fc7504-a5a3-4175-ad63-c8a2de52fa52" acquired by "delete_volume" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c3250-d7c3-4478-a1ae-d49a76407356]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (1b8f2118-75db-4757-a64f-329c0037c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb16d5f6-ed2b-4377-9c3f-2129e112ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb16d5f6-ed2b-4377-9c3f-2129e112ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355059608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c98f329-c81c-4490-a8a1-e4300f2c0065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:59Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300c9e9b-bb2c-48d5-8590-8106e2ab6eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300c9e9b-bb2c-48d5-8590-8106e2ab6eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a2c3ae-591b-4d6b-96c1-0f5de68d0457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a2c3ae-591b-4d6b-96c1-0f5de68d0457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c98f329-c81c-4490-a8a1-e4300f2c0065', 'volume_name': 'volume-7c98f329-c81c-4490-a8a1-e4300f2c0065', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c5be6a-5bd1-4c31-aaca-fe2736a782d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c5be6a-5bd1-4c31-aaca-fe2736a782d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3103c1a-70b2-4420-bdf0-67821f811b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume 7c98f329-c81c-4490-a8a1-e4300f2c0065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c98f329-c81c-4490-a8a1-e4300f2c0065', 'volume_size': 1} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:59 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01" returned: 0 in 0.541s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:59 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 is being set with open permissions: ugo+rw Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:59 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 Feb 24 11:09:59 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:59 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 Feb 24 11:09:59 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (5b0d2cc2-9732-4b7b-a11f-4d2c369ccce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f123b505-d900-468a-91ed-c9834e01ca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f123b505-d900-468a-91ed-c9834e01ca02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1394515480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392a46f7-c1eb-4ba3-9924-3a61f6a925a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:00Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4018781-f5b6-4dca-ae7f-0c86df749717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4018781-f5b6-4dca-ae7f-0c86df749717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5393f68-d54f-4066-982b-d80f62f6c96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5393f68-d54f-4066-982b-d80f62f6c96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392a46f7-c1eb-4ba3-9924-3a61f6a925a6', 'volume_name': 'volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6bd7b5-24ef-4459-aa0a-f7ec037364c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6bd7b5-24ef-4459-aa0a-f7ec037364c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a4f1e7-816f-42f2-a457-d95e7a9ff76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume 392a46f7-c1eb-4ba3-9924-3a61f6a925a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6', 'volume_size': 1} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (ccfc1b04-535b-45b3-be27-168de146699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1a1d90-e3f7-40d5-b620-7098fa772154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1a1d90-e3f7-40d5-b620-7098fa772154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1932713200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6755e71a-592f-4452-a141-0b112294a643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:00Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88329f8-9653-4484-8d51-e7625276766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88329f8-9653-4484-8d51-e7625276766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9481376e-1bbd-46b7-8974-ec1c8dd49b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9481376e-1bbd-46b7-8974-ec1c8dd49b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6755e71a-592f-4452-a141-0b112294a643', 'volume_name': 'volume-6755e71a-592f-4452-a141-0b112294a643', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feca544d-2e64-4012-a7c8-5e405cbf0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feca544d-2e64-4012-a7c8-5e405cbf0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b444c2-9307-43a5-917b-bf7022a27d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:09:59 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume 6755e71a-592f-4452-a141-0b112294a643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6755e71a-592f-4452-a141-0b112294a643', 'volume_size': 1} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:09:59 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52" returned: 0 in 0.643s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:59 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01" returned: 0 in 0.506s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:09:59 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52 Feb 24 11:09:59 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:09:59 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:09:59 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.info Feb 24 11:09:59 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (2a31500f-bb87-4b7a-88c6-f493dcc6e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77035ff4-655c-45e5-a686-73b80915ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77035ff4-655c-45e5-a686-73b80915ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381312079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da18461-9a30-47bf-bb5a-b852fb683b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:00Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1f9b43-3501-4785-a537-08e9729913ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1f9b43-3501-4785-a537-08e9729913ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3f6065-8cb9-45e6-a8ae-eb6951374665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3f6065-8cb9-45e6-a8ae-eb6951374665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da18461-9a30-47bf-bb5a-b852fb683b8e', 'volume_name': 'volume-6da18461-9a30-47bf-bb5a-b852fb683b8e', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ed5e11-b248-4be4-93b0-4d2942332434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ed5e11-b248-4be4-93b0-4d2942332434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f669776-cc3c-4f55-bd6a-79ad65860ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:00 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume 6da18461-9a30-47bf-bb5a-b852fb683b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da18461-9a30-47bf-bb5a-b852fb683b8e', 'volume_size': 1} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:00 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-18fc7504-a5a3-4175-ad63-c8a2de52fa52" returned: 0 in 0.421s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-18fc7504-a5a3-4175-ad63-c8a2de52fa52" released by "delete_volume" :: held 1.091s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created reservations ['85c619dd-a891-4820-8d38-10cd2decaf06', 'b0f0db89-de8d-4b1c-9911-b3772ca12b5b', 'b8d59e72-c896-4060-9d58-6648c0ddba15', 'bce9aac3-4e1a-492f-926e-96cb5263b150'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:00 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.info" returned: 0 in 0.443s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:00 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.info is being set with open permissions: ugo+rw Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:00 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.info Feb 24 11:10:00 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:00 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:00 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:00 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.info" returned: 0 in 0.416s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.947s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.503s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468509343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad00396-fd84-4bad-8455-9c2590b7b064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0713cf10cee4b60bdc720ef246c1229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:57Z,use_quota=True,user_id='94fd05abfdd64d19ae4baccfcdd3924d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Creating volume 6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:00 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:00 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.440s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:00 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 1073741824 Feb 24 11:10:00 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-59785b30-6d40-4a2e-963c-af4d80124c04 tempest-SnapshotDependencyTests-317989621 None] Create snapshot completed successfully Feb 24 11:10:00 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Deleted volume successfully. Feb 24 11:10:00 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0aa66e09-a414-4433-b73a-cf2835446467 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-18fc7504-a5a3-4175-ad63-c8a2de52fa52-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:01 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 1073741824" returned: 0 in 0.507s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-fd9baa96-4c39-42de-875a-3d82d2cc8654-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:01 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 Feb 24 11:10:01 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-fd9baa96-4c39-42de-875a-3d82d2cc8654-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-quobyte-fd9baa96-4c39-42de-875a-3d82d2cc8654" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-fd9baa96-4c39-42de-875a-3d82d2cc8654" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b02206-04a7-4ced-a7ac-7b3267de0796]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:01 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 Feb 24 11:10:01 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:01 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064" returned: 0 in 0.434s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772281884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7608b45-27b4-42ed-bfee-d55fe68d7e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:59Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Creating volume e7608b45-27b4-42ed-bfee-d55fe68d7e60 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:01 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96bfca8-da38-4673-b634-b506aef44289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ad00396-fd84-4bad-8455-9c2590b7b064', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:01 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 1073741824 Feb 24 11:10:01 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d63d64-967a-4cf0-8082-337cd5243bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:01 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Volume volume-6ad00396-fd84-4bad-8455-9c2590b7b064 (6ad00396-fd84-4bad-8455-9c2590b7b064): created successfully Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d63d64-967a-4cf0-8082-337cd5243bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:01 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Flow 'volume_create_manager' (e453936f-1eb5-47ee-b0ca-0ce037987b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:01 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-48ffc0e1-6788-4e60-8779-61dfc25915a8 tempest-VolumeDependencyTests-1203560447 None] Created volume successfully. Feb 24 11:10:02 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654" returned: 0 in 0.520s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:02 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654 Feb 24 11:10:02 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Flow 'volume_create_manager' (e5485cd1-c41f-4841-981e-d02bda3a34ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b578be9-66cb-4920-b5f7-bdf5d940c965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b578be9-66cb-4920-b5f7-bdf5d940c965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0284a6-68d5-4b27-8e65-cb5050fc4d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257a89e0716a4d4fb498471eeb632080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a948796b-b2b1-4a8b-91f1-494539bbff01,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:02Z,use_quota=True,user_id='9ee3effe33de475d9474301cc05dfae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272caad1-ab35-4152-82f5-08992bf0b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272caad1-ab35-4152-82f5-08992bf0b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329f8468-ca57-4e03-8785-e79488756193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329f8468-ca57-4e03-8785-e79488756193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de0284a6-68d5-4b27-8e65-cb5050fc4d2d', 'volume_name': 'volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d', 'volume_size': 1, 'snapshot_id': 'a948796b-b2b1-4a8b-91f1-494539bbff01'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca551f36-2fcb-4e4c-978f-466271e070e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca551f36-2fcb-4e4c-978f-466271e070e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2b0a9c-5da0-453d-819c-d75eabdc7303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Volume de0284a6-68d5-4b27-8e65-cb5050fc4d2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d', 'volume_size': 1, 'snapshot_id': 'a948796b-b2b1-4a8b-91f1-494539bbff01'} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:02 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 1073741824" returned: 0 in 0.579s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:02 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 Feb 24 11:10:02 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:02 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-fd9baa96-4c39-42de-875a-3d82d2cc8654" returned: 0 in 0.498s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-fd9baa96-4c39-42de-875a-3d82d2cc8654" released by "delete_volume" :: held 1.058s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created reservations ['deb1691e-8ee3-4631-a086-aefa0cd701f5', 'd08f8403-30ef-4323-bb9f-9e93e4644327', 'c2897e12-595c-40e9-9a2a-f6c224ed6248', '359eb680-98ef-4501-82ae-25e85a4d399c'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:02 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:02 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Flow 'volume_create_manager' (bd6cd041-2160-4ebb-83ae-47bec0aa65cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df249501-5998-4447-b80a-4e0591c615dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df249501-5998-4447-b80a-4e0591c615dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1269099599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65665eae-ec28-408f-844b-14961a6aa3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0713cf10cee4b60bdc720ef246c1229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6ad00396-fd84-4bad-8455-9c2590b7b064,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:03Z,use_quota=True,user_id='94fd05abfdd64d19ae4baccfcdd3924d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9720b3c-8845-4b30-8971-62a5b6c10459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9720b3c-8845-4b30-8971-62a5b6c10459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c545d1d-e961-4ff6-95e1-adce77a1e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60" returned: 0 in 0.462s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.492s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355059608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c98f329-c81c-4490-a8a1-e4300f2c0065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:09:59Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Creating volume 7c98f329-c81c-4490-a8a1-e4300f2c0065 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:02 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c545d1d-e961-4ff6-95e1-adce77a1e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '65665eae-ec28-408f-844b-14961a6aa3de', 'volume_name': 'volume-65665eae-ec28-408f-844b-14961a6aa3de', 'volume_size': 1, 'source_volid': '6ad00396-fd84-4bad-8455-9c2590b7b064', 'source_volstatus': 'available'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53360079-b421-49ce-bb53-fd981831c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53360079-b421-49ce-bb53-fd981831c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 1073741824 Feb 24 11:10:02 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ed81d8-d020-4377-bdb2-973f4c085412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Volume 65665eae-ec28-408f-844b-14961a6aa3de: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-65665eae-ec28-408f-844b-14961a6aa3de', 'volume_size': 1, 'source_volid': '6ad00396-fd84-4bad-8455-9c2590b7b064', 'source_volstatus': 'available'} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fdbe40-4c2c-4e9f-b3ec-9acf520803f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a03932c-b354-4dc4-a859-b8162616c6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:02 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 (e7608b45-27b4-42ed-bfee-d55fe68d7e60): created successfully Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a03932c-b354-4dc4-a859-b8162616c6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:02 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (515eae34-9d88-423b-9086-9a8c68068d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:02 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-de494ffc-78df-4644-855c-568adf0643b6 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created volume successfully. Feb 24 11:10:03 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.517s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:03 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Deleted volume successfully. Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cae374ac-9555-4eeb-8fd0-fcc5dcf5c9d7 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-fd9baa96-4c39-42de-875a-3d82d2cc8654-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:03 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 1073741824" returned: 0 in 0.511s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:03 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 Feb 24 11:10:03 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-quobyte-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b84912e-e8ec-4e82-abad-5a292dffdbc5]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:03 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 Feb 24 11:10:03 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:03 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065" returned: 0 in 0.445s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.268s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1394515480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392a46f7-c1eb-4ba3-9924-3a61f6a925a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:00Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Creating volume 392a46f7-c1eb-4ba3-9924-3a61f6a925a6 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:03 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3103c1a-70b2-4420-bdf0-67821f811b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c98f329-c81c-4490-a8a1-e4300f2c0065', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368c778c-0ceb-467a-91bb-9a5920a6e4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:03 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 1073741824 Feb 24 11:10:03 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:03 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 (7c98f329-c81c-4490-a8a1-e4300f2c0065): created successfully Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368c778c-0ceb-467a-91bb-9a5920a6e4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:03 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (1b8f2118-75db-4757-a64f-329c0037c875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:03 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-84426d7f-83c9-4562-8e42-fd63cbff1f79 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created volume successfully. Feb 24 11:10:04 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680" returned: 0 in 0.507s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:04 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680 Feb 24 11:10:04 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:04 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 1073741824" returned: 0 in 0.539s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:04 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 Feb 24 11:10:04 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:04 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680" returned: 0 in 0.457s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680" released by "delete_volume" :: held 0.988s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created reservations ['ce51906c-8e3c-4b3d-b907-bf8f22216c67', 'a5ae8eb5-3fd8-4933-8962-6e593ec6839d', 'c2034325-4746-4a7b-9f7c-6b7b34ae9419', 'a913432e-50db-41a2-9e75-0be6bae9e617'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:04 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:04 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:04 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6" returned: 0 in 0.424s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.076s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1932713200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6755e71a-592f-4452-a141-0b112294a643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:00Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Creating volume 6755e71a-592f-4452-a141-0b112294a643 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:04 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a4f1e7-816f-42f2-a457-d95e7a9ff76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:04 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 1073741824 Feb 24 11:10:04 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cb1a08-ce5f-41f4-9fbd-44390a5a2e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:04 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 (392a46f7-c1eb-4ba3-9924-3a61f6a925a6): created successfully Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cb1a08-ce5f-41f4-9fbd-44390a5a2e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:04 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (5b0d2cc2-9732-4b7b-a11f-4d2c369ccce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:04 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-241f70d4-1772-4da1-9841-fe61ba8055f8 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created volume successfully. Feb 24 11:10:05 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.423s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:05 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Deleted volume successfully. Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-01116636-2d0f-4ed1-a195-0b87f8254407 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-e6bd00f8-f5ca-4c65-a1d8-a3e9c5472680-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:05 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 1073741824" returned: 0 in 0.566s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:05 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 Feb 24 11:10:05 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-quobyte-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6" acquired by "delete_volume" :: waited 0.019s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb04c2-29d6-40ed-830b-2f5f0ff415c3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:05 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 Feb 24 11:10:05 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:05 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643" returned: 0 in 0.429s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.864s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381312079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da18461-9a30-47bf-bb5a-b852fb683b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d8b8ea85414f01b5b33eed3a83233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:00Z,use_quota=True,user_id='fbabaabc2f7f4ed2b5b7890703f5f2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Creating volume 6da18461-9a30-47bf-bb5a-b852fb683b8e {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:05 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b444c2-9307-43a5-917b-bf7022a27d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6755e71a-592f-4452-a141-0b112294a643', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:05 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e 1073741824 Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435cdb86-5c86-4cff-a2fa-836bcfa85928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:05 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:05 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume volume-6755e71a-592f-4452-a141-0b112294a643 (6755e71a-592f-4452-a141-0b112294a643): created successfully Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435cdb86-5c86-4cff-a2fa-836bcfa85928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:05 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (ccfc1b04-535b-45b3-be27-168de146699a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:05 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9cf6b20d-6b25-425c-86ce-b92c3839b238 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created volume successfully. Feb 24 11:10:06 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6" returned: 0 in 0.532s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:06 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6 Feb 24 11:10:06 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:06 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e 1073741824" returned: 0 in 0.502s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:06 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e Feb 24 11:10:06 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:06 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6" returned: 0 in 0.450s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6" released by "delete_volume" :: held 1.005s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created reservations ['10c50c2b-54dc-4597-9a1e-f78e4aad7fff', '058c042b-dee8-4e3b-8fd6-aae0fef4f26e', '8371dea1-1c83-4163-9dc8-7b40c9c1976a', '7e65198e-c9a3-4b95-95a3-6af2ab8257ce'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:06 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e" returned: 0 in 0.434s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.516s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-quobyte-a948796b-b2b1-4a8b-91f1-494539bbff01-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" by "_create_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f669776-cc3c-4f55-bd6a-79ad65860ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da18461-9a30-47bf-bb5a-b852fb683b8e', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1596b96d-4298-4aba-bd48-2df8ba127a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-a948796b-b2b1-4a8b-91f1-494539bbff01-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Creating volume de0284a6-68d5-4b27-8e65-cb5050fc4d2d from snapshot a948796b-b2b1-4a8b-91f1-494539bbff01 {{(pid=82627) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-quobyte-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:06 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Volume volume-6da18461-9a30-47bf-bb5a-b852fb683b8e (6da18461-9a30-47bf-bb5a-b852fb683b8e): created successfully Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1596b96d-4298-4aba-bd48-2df8ba127a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Flow 'volume_create_manager' (2a31500f-bb87-4b7a-88c6-f493dcc6e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] snapshot: a948796b-b2b1-4a8b-91f1-494539bbff01, volume: de0284a6-68d5-4b27-8e65-cb5050fc4d2d, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:10:06 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:06 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-14d5f644-165b-4190-83c5-ed22010368ba tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created volume successfully. Feb 24 11:10:06 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[713c48fc-f33a-4795-a0b3-8397fb401d67]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:06 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:07 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 Feb 24 11:10:07 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:07 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.410s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:07 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Deleted volume successfully. Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-80563c7e-36a9-476f-93a4-59c0814f6c93 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-91e3eee3-e48c-4bdd-8a39-aa1b350d8eb6-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:07 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01" returned: 0 in 0.499s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ea0e7-61da-49e4-b450-660067af583a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-6da18461-9a30-47bf-bb5a-b852fb683b8e-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:07 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e Feb 24 11:10:07 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-6da18461-9a30-47bf-bb5a-b852fb683b8e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-quobyte-6da18461-9a30-47bf-bb5a-b852fb683b8e" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-6da18461-9a30-47bf-bb5a-b852fb683b8e" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9047346-bd03-4f71-9eac-121d578d6141]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:07 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e Feb 24 11:10:07 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-2813874e-5e37-461d-8c83-637a5b9b90f2-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-2813874e-5e37-461d-8c83-637a5b9b90f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-quobyte-649ae679-2c91-406e-a153-834209a63a5a" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-649ae679-2c91-406e-a153-834209a63a5a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-quobyte-2813874e-5e37-461d-8c83-637a5b9b90f2" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-2813874e-5e37-461d-8c83-637a5b9b90f2" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:07 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Deleting offline snapshot 2813874e-5e37-461d-8c83-637a5b9b90f2 of volume 649ae679-2c91-406e-a153-834209a63a5a {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] snapshot_file for this snap is: volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[937990c9-28b8-40c9-8b73-c03968a48c6d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:08 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" returned: 0 in 0.532s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:08 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d Feb 24 11:10:08 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:08 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 Feb 24 11:10:08 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:08 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e" returned: 0 in 0.496s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:08 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e Feb 24 11:10:08 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:08 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2" returned: 0 in 0.641s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-649ae679-2c91-406e-a153-834209a63a5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f6daca-2260-4a50-b147-272d5265b285]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:08 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6da18461-9a30-47bf-bb5a-b852fb683b8e" returned: 0 in 0.637s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:08 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-6da18461-9a30-47bf-bb5a-b852fb683b8e" released by "delete_volume" :: held 1.202s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:08 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a Feb 24 11:10:08 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created reservations ['70840cb6-8755-43bc-8a46-8359dfb1453c', 'fc1f073f-e6a8-4ba7-a971-d301651ebbcb', 'cff101e0-00b8-4b96-a40e-5e50c79273d9', '60808596-c9a8-4f51-8cd7-420169f3a181'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:09 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:09 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-6755e71a-592f-4452-a141-0b112294a643-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:09 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-6755e71a-592f-4452-a141-0b112294a643-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:10 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a" returned: 0 in 1.340s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:10 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 Feb 24 11:10:10 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-quobyte-6755e71a-592f-4452-a141-0b112294a643" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-6755e71a-592f-4452-a141-0b112294a643" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a470724f-b8d9-458b-b324-676fd258223a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:10 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" returned: 0 in 2.325s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7fdcf9-2d25-47b4-ba4b-54d02dec4efd]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:10 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.055s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:10 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:10 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:10 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Deleted volume successfully. Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-229990eb-82c1-4a96-b569-93ff3edb3f77 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-6da18461-9a30-47bf-bb5a-b852fb683b8e-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:10 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e Feb 24 11:10:10 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:10 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2" returned: 0 in 0.654s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:10 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2 Feb 24 11:10:10 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:10 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643" returned: 0 in 0.536s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:10 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:10 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643 Feb 24 11:10:10 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:11 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" returned: 0 in 0.639s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:10:11 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Converted 1024.00 MB image at 440.16 MB/s Feb 24 11:10:11 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d is being set with open permissions: ugo+rw Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:11 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d Feb 24 11:10:11 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:11 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a.2813874e-5e37-461d-8c83-637a5b9b90f2" returned: 0 in 0.435s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-2813874e-5e37-461d-8c83-637a5b9b90f2" released by "_delete_snapshot" :: held 3.172s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-649ae679-2c91-406e-a153-834209a63a5a" released by "delete_snapshot" :: held 3.187s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created reservations ['9dc6e6cf-d850-4751-8815-9aef4f30c715', 'edef0c9f-2265-4127-bbdb-c3722b0f4f1d', '7d136e2e-cb97-47d8-9c0d-6ce54526a6ad', 'e559585c-d7ac-4ad2-aadc-56fe6effcf35'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Delete snapshot completed successfully. Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68e04a9f-aa86-4d70-a574-42afdac8c070 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-2813874e-5e37-461d-8c83-637a5b9b90f2-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:11 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6755e71a-592f-4452-a141-0b112294a643" returned: 0 in 0.433s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-6755e71a-592f-4452-a141-0b112294a643" released by "delete_volume" :: held 0.993s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created reservations ['c064a121-5fe0-496e-b125-27959ece7545', '31729fe0-2a6e-49fe-8195-dd28138287d1', 'da59bc21-87a6-4ee6-b636-3bf46cf2ee0d', 'd5b4372b-42ad-4789-bf45-421be0510f5a'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:11 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:11 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:11 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" returned: 0 in 0.476s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" released by "_copy_volume_from_snapshot" :: held 4.540s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-a948796b-b2b1-4a8b-91f1-494539bbff01-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" released by "_create_volume_from_snapshot" :: held 4.587s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.609s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.550s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:11 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Cloning volume 6ad00396-fd84-4bad-8455-9c2590b7b064 to volume 65665eae-ec28-408f-844b-14961a6aa3de Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Creating offline snapshot 0a563d35-c9ea-4271-b288-6485bcc5db7f of volume 6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2b0a9c-5da0-453d-819c-d75eabdc7303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d', 'volume_size': 1, 'snapshot_id': 'a948796b-b2b1-4a8b-91f1-494539bbff01'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60537273-2f7d-4d98-8206-9c1f4dce1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a04db-5f2e-4b2f-bdb2-d072093d4599]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:11 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Volume volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d (de0284a6-68d5-4b27-8e65-cb5050fc4d2d): created successfully Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60537273-2f7d-4d98-8206-9c1f4dce1c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Flow 'volume_create_manager' (e5485cd1-c41f-4841-981e-d02bda3a34ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f48fe4ce-91fd-4064-8444-5fffe6030c2a tempest-SnapshotDependencyTests-317989621 None] Created volume successfully. Feb 24 11:10:11 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 Feb 24 11:10:11 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:11 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.430s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:11 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Deleted volume successfully. Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-1be2e4e7-1c2f-4c67-bb6a-7635848ad6e3 tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-6755e71a-592f-4452-a141-0b112294a643-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-a948796b-b2b1-4a8b-91f1-494539bbff01-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-a948796b-b2b1-4a8b-91f1-494539bbff01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-quobyte-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-quobyte-a948796b-b2b1-4a8b-91f1-494539bbff01" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-a948796b-b2b1-4a8b-91f1-494539bbff01" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Deleting offline snapshot a948796b-b2b1-4a8b-91f1-494539bbff01 of volume 1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] snapshot_file for this snap is: volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3394d6d1-1f96-4e4f-98f7-2b188c3cb7a8]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:11 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:12 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 Feb 24 11:10:12 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:12 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064" returned: 0 in 0.506s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:12 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f 1G Feb 24 11:10:12 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-392a46f7-c1eb-4ba3-9924-3a61f6a925a6-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-392a46f7-c1eb-4ba3-9924-3a61f6a925a6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-quobyte-392a46f7-c1eb-4ba3-9924-3a61f6a925a6" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-649ae679-2c91-406e-a153-834209a63a5a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-392a46f7-c1eb-4ba3-9924-3a61f6a925a6" acquired by "delete_volume" :: waited 0.032s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-649ae679-2c91-406e-a153-834209a63a5a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec1d6af-518e-4f66-afd4-85b0523a88a1]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "cinder-quobyte-649ae679-2c91-406e-a153-834209a63a5a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-649ae679-2c91-406e-a153-834209a63a5a" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32dafea-c418-4abf-8e84-5b4136916d8e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:12 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 Feb 24 11:10:12 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:12 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a Feb 24 11:10:12 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:12 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01" returned: 0 in 0.558s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcea3e4-e851-4f0c-bacf-23de8e541f72]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:12 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:12 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e Feb 24 11:10:12 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f 1G" returned: 0 in 0.561s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ad00396-fd84-4bad-8455-9c2590b7b064 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:12 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ad00396-fd84-4bad-8455-9c2590b7b064 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f Feb 24 11:10:12 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:12 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6" returned: 0 in 0.550s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:12 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6 Feb 24 11:10:12 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:12 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a" returned: 0 in 0.537s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:12 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:12 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a Feb 24 11:10:12 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:13 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" returned: 0 in 0.510s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:13 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ad00396-fd84-4bad-8455-9c2590b7b064 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f" returned: 0 in 0.456s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f is being set with open permissions: ugo+rw Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:13 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 Feb 24 11:10:13 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:13 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f Feb 24 11:10:13 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:13 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-392a46f7-c1eb-4ba3-9924-3a61f6a925a6" returned: 0 in 0.407s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-392a46f7-c1eb-4ba3-9924-3a61f6a925a6" released by "delete_volume" :: held 0.982s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created reservations ['fb8e07ed-3666-40b5-866e-72720edf0148', '4e3deccf-463d-4141-a5ae-15b9a41f7e19', 'af33b5c3-213b-4e09-b456-8972d29b4c52', 'd30f376a-d1d0-4941-948c-e518cc9cf6b1'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:13 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-649ae679-2c91-406e-a153-834209a63a5a" returned: 0 in 0.486s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-quobyte-649ae679-2c91-406e-a153-834209a63a5a" released by "delete_volume" :: held 1.055s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:13 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:13 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Created reservations ['6fd77567-d0ac-4516-b1e5-dfcb02c648fa', '83ae9e33-1f39-43ee-b41b-968a18eec774', 'f09f2466-a4a0-4ac3-bb8c-9c0cd3f26c0e', '5fe3d63b-94b3-4df7-99e8-6e8d899d4501'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:13 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:13 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:13 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f" returned: 0 in 0.471s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:13 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.info Feb 24 11:10:13 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:13 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01" returned: 0 in 0.559s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:13 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01 Feb 24 11:10:13 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:13 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.453s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Deleted volume successfully. Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-5caa13a1-af07-4f8a-bb1f-51d8958f288b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-392a46f7-c1eb-4ba3-9924-3a61f6a925a6-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:13 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.469s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:13 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Deleted volume successfully. Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-68f8099b-ba7e-491d-9a5d-1b2de15b1190 tempest-CreateVolumesFromSnapshotTest-1888504184 None] Lock "cinder-649ae679-2c91-406e-a153-834209a63a5a-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:13 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.info" returned: 0 in 0.425s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:13 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.info is being set with open permissions: ugo+rw Feb 24 11:10:13 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:14 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.info Feb 24 11:10:14 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:14 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e.a948796b-b2b1-4a8b-91f1-494539bbff01" returned: 0 in 0.417s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-a948796b-b2b1-4a8b-91f1-494539bbff01" released by "_delete_snapshot" :: held 2.101s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" released by "delete_snapshot" :: held 2.111s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Created reservations ['228d9ed0-6249-40da-9ce5-fe3ed08e1608', '527d6477-ea52-44ca-9477-09a6e6e5663c', '005bb2e8-1db2-4ec4-a858-4bec9edff790', 'b93b62ba-7f4e-4749-aeae-08fbda1ca38e'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:14 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Delete snapshot completed successfully. Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-3986bdb6-6a9d-4c09-bede-9a3f4a302f7d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-a948796b-b2b1-4a8b-91f1-494539bbff01-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-7c98f329-c81c-4490-a8a1-e4300f2c0065-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-7c98f329-c81c-4490-a8a1-e4300f2c0065-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-quobyte-7c98f329-c81c-4490-a8a1-e4300f2c0065" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:14 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.info" returned: 0 in 0.443s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-65665eae-ec28-408f-844b-14961a6aa3de" by "_copy_volume_from_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-7c98f329-c81c-4490-a8a1-e4300f2c0065" acquired by "delete_volume" :: waited 0.020s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-65665eae-ec28-408f-844b-14961a6aa3de" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] snapshot: 0a563d35-c9ea-4271-b288-6485bcc5db7f, volume: 65665eae-ec28-408f-844b-14961a6aa3de, {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0314d2-344d-44a8-a9b8-6ede753344c8]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed9713c-2f95-463d-aea9-d1861e888a8b]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:14 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:14 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 Feb 24 11:10:14 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:14 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f Feb 24 11:10:14 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:15 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:15 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f" returned: 0 in 0.555s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ad00396-fd84-4bad-8455-9c2590b7b064(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Creating direct copy from snapshot {{(pid=82627) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065" returned: 0 in 0.571s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd7da5-113e-4c6b-887f-21208ea75fe5]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:15 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065 Feb 24 11:10:15 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-1be0a03c-bb29-4cdf-ad44-0a360a127a2e-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-1be0a03c-bb29-4cdf-ad44-0a360a127a2e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-quobyte-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" acquired by "delete_volume" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:15 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 Feb 24 11:10:15 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e47e4d7-8aec-47b7-9bc8-b10a6b73e89a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:15 devstack sudo[91349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e Feb 24 11:10:15 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:15 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:15 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064" returned: 0 in 0.650s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.utils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Path /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de not found in is_blk_device check {{(pid=82627) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7c98f329-c81c-4490-a8a1-e4300f2c0065" returned: 0 in 0.678s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-7c98f329-c81c-4490-a8a1-e4300f2c0065" released by "delete_volume" :: held 1.302s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:15 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de Feb 24 11:10:15 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:15 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" returned: 0 in 0.573s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:15 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e Feb 24 11:10:15 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created reservations ['6faff867-5977-4c92-b0d3-1e399635a4bb', '90e2c417-e366-460d-868f-04982bca0c1f', 'a112786a-dccf-40ae-b4e6-3f9eaa09880f', '669f068e-9be6-485b-8ce4-648a51f3323a'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:15 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:15 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:15 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:16 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" returned: 0 in 0.605s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-1be0a03c-bb29-4cdf-ad44-0a360a127a2e" released by "delete_volume" :: held 1.231s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Created reservations ['1b2ba2ba-dc51-4ff9-a5b2-9e3c97ea1138', '9c04a7b9-9b0a-4f48-8af9-971914cafd25', '1b307ca5-e544-4463-84f3-7c48217c3941', 'eabf74f0-f5c3-489e-bf88-bb46f6f8e24c'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:16 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-e7608b45-27b4-42ed-bfee-d55fe68d7e60-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.046s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:16 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-e7608b45-27b4-42ed-bfee-d55fe68d7e60-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:16 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:16 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:16 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Deleted volume successfully. Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-cbf5a8d8-b098-4843-ab57-a4a5d5a7d89b tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-7c98f329-c81c-4490-a8a1-e4300f2c0065-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-quobyte-e7608b45-27b4-42ed-bfee-d55fe68d7e60" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-e7608b45-27b4-42ed-bfee-d55fe68d7e60" acquired by "delete_volume" :: waited 0.026s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a38f44-c7e1-4b99-858c-0db23a2e0894]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:17 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 Feb 24 11:10:17 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-de0284a6-68d5-4b27-8e65-cb5050fc4d2d-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-de0284a6-68d5-4b27-8e65-cb5050fc4d2d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "cinder-quobyte-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" acquired by "delete_volume" :: waited 0.016s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab73f80-2085-4e6b-af4d-e2ee841cf1b5]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:17 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:18 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d Feb 24 11:10:18 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:18 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de" returned: 0 in 2.296s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[641c9542-95b6-4e62-97d6-52727a819e30]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:18 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 Feb 24 11:10:18 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:18 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 1.296s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:18 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Deleted volume successfully. Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f1308c13-9341-4647-8290-6153ba6e1b88 tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-1be0a03c-bb29-4cdf-ad44-0a360a127a2e-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:18 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60" returned: 0 in 1.176s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:18 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60 Feb 24 11:10:18 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:18 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" returned: 0 in 0.585s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:18 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d Feb 24 11:10:18 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:18 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064" returned: 0 in 0.616s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.image.image_utils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Image conversion details: src /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de {{(pid=82627) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 24 11:10:18 devstack cinder-volume[82627]: INFO cinder.image.image_utils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Converted 1024.00 MB image at 445.74 MB/s Feb 24 11:10:18 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de is being set with open permissions: ugo+rw Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:18 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de Feb 24 11:10:18 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:18 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-e7608b45-27b4-42ed-bfee-d55fe68d7e60" returned: 0 in 0.438s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-e7608b45-27b4-42ed-bfee-d55fe68d7e60" released by "delete_volume" :: held 1.660s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created reservations ['5b30067a-c11e-41ca-9931-6620e506a2af', '9d72bcb5-9063-4ab4-b851-80ab92e67bca', 'd74e975a-6db8-4812-8f69-1504cfd99172', 'c06e156a-0313-47ac-86e2-f96ede8bfdca'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:18 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:18 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:18 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" returned: 0 in 0.456s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-quobyte-de0284a6-68d5-4b27-8e65-cb5050fc4d2d" released by "delete_volume" :: held 1.088s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Created reservations ['c615551b-5954-4636-b725-db1a6745defa', '623e275a-3834-4639-b967-38c32be6fd11', '57d6e983-bd14-49d5-9d4e-6b2505dc3703', 'e12866a2-94f5-4a9f-b35f-45707eb88e38'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:18 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:18 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:18 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-7b5cfa12-5516-4087-ad20-72938db798b9-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-7b5cfa12-5516-4087-ad20-72938db798b9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "cinder-quobyte-7b5cfa12-5516-4087-ad20-72938db798b9" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-7b5cfa12-5516-4087-ad20-72938db798b9" acquired by "delete_volume" :: waited 0.008s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:19 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de" returned: 0 in 0.462s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb76d0c-5353-4f7a-a5e8-60de46de193e]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-65665eae-ec28-408f-844b-14961a6aa3de" released by "_copy_volume_from_snapshot" :: held 4.666s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-0a563d35-c9ea-4271-b288-6485bcc5db7f" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-0a563d35-c9ea-4271-b288-6485bcc5db7f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Deleting offline snapshot 0a563d35-c9ea-4271-b288-6485bcc5db7f of volume 6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] snapshot_file for this snap is: volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[769b4374-cf34-4107-8767-5012180c3c4d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:19 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 Feb 24 11:10:19 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:19 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f Feb 24 11:10:19 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:19 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.485s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Deleted volume successfully. Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-f608d24c-f649-41b5-97d2-cd8d4b36d44c tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-e7608b45-27b4-42ed-bfee-d55fe68d7e60-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:19 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.475s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:19 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Deleted volume successfully. Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-9bd1c37d-ec82-4296-b84d-87f280470f2d tempest-SnapshotDependencyTests-317989621 None] Lock "cinder-de0284a6-68d5-4b27-8e65-cb5050fc4d2d-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:19 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9" returned: 0 in 0.493s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:19 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9 Feb 24 11:10:19 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:19 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f" returned: 0 in 0.531s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ad00396-fd84-4bad-8455-9c2590b7b064(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2d79e9-4302-48f4-9cfd-f324bf23e1a3]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:19 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:19 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 Feb 24 11:10:19 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:20 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-7b5cfa12-5516-4087-ad20-72938db798b9" returned: 0 in 0.442s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-quobyte-7b5cfa12-5516-4087-ad20-72938db798b9" released by "delete_volume" :: held 0.958s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Created reservations ['fc43374d-d4b6-4ea3-86ed-6115fed1d790', '10dc6d6c-92d4-4bd0-b1aa-4f32c3307cca', '230a68e9-72c4-4150-bc79-02e8e11ab586', 'd5ce6195-266c-42d7-b411-0b3035c6b820'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:20 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:20 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:20 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064" returned: 0 in 0.520s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:20 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f Feb 24 11:10:20 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:20 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.542s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:20 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Deleted volume successfully. Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-112d8aa6-5461-4c7f-9937-02e76475e17d tempest-CreateVolumesFromSourceVolumeTest-1156920955 None] Lock "cinder-7b5cfa12-5516-4087-ad20-72938db798b9-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:20 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f" returned: 0 in 0.558s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:20 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:20 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f Feb 24 11:10:20 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:21 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064.0a563d35-c9ea-4271-b288-6485bcc5db7f" returned: 0 in 0.479s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:21 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-0a563d35-c9ea-4271-b288-6485bcc5db7f" released by "_delete_snapshot" :: held 2.142s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:21 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.832s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ed81d8-d020-4377-bdb2-973f4c085412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65665eae-ec28-408f-844b-14961a6aa3de', 'volume_size': 1, 'source_volid': '6ad00396-fd84-4bad-8455-9c2590b7b064', 'source_volstatus': 'available'}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966db6f2-333e-4ebe-b0c6-433c49123e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:21 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Volume volume-65665eae-ec28-408f-844b-14961a6aa3de (65665eae-ec28-408f-844b-14961a6aa3de): created successfully Feb 24 11:10:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966db6f2-333e-4ebe-b0c6-433c49123e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:21 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Flow 'volume_create_manager' (bd6cd041-2160-4ebb-83ae-47bec0aa65cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:21 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-647e4fe6-9a71-4d74-a1bc-0cdc4c00ff9c tempest-VolumeDependencyTests-1203560447 None] Created volume successfully. Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Flow 'volume_create_manager' (302b5c40-87c1-4e79-bd8d-fdd3fed69837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f415247-81a3-4f8b-a8fb-e2ca75cd9fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f415247-81a3-4f8b-a8fb-e2ca75cd9fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4734962a7a4bd48f73a06d21d06850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:22Z,use_quota=True,user_id='80387bc28f264a2d86eea47f054a8b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be05bceb-f7ea-421f-aefe-e7c7c9f7cd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be05bceb-f7ea-421f-aefe-e7c7c9f7cd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c608f86-a483-47b9-8cce-2a111d9ba72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c608f86-a483-47b9-8cce-2a111d9ba72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a', 'volume_name': 'volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab12f92-71f8-4bcf-8978-5ddfed20e103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab12f92-71f8-4bcf-8978-5ddfed20e103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013e659a-5496-49c0-a977-2ecf6ae1fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:22 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Volume 1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a', 'volume_size': 1} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4734962a7a4bd48f73a06d21d06850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:22Z,use_quota=True,user_id='80387bc28f264a2d86eea47f054a8b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Creating volume 1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:22 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:22 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a 1073741824 Feb 24 11:10:22 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-6ad00396-fd84-4bad-8455-9c2590b7b064-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-6ad00396-fd84-4bad-8455-9c2590b7b064-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-6ad00396-fd84-4bad-8455-9c2590b7b064" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-6ad00396-fd84-4bad-8455-9c2590b7b064" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9733ceb-3cbb-4579-a9c7-6b075f8d3f04]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:22 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 Feb 24 11:10:22 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:22 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a 1073741824" returned: 0 in 0.627s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:22 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a Feb 24 11:10:22 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:22 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064" returned: 0 in 0.596s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:22 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:22 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064 Feb 24 11:10:22 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:23 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a" returned: 0 in 0.489s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013e659a-5496-49c0-a977-2ecf6ae1fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455e3ff4-aa8c-463f-8395-8ee157c3fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:23 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:23 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Volume volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a (1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a): created successfully Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455e3ff4-aa8c-463f-8395-8ee157c3fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Flow 'volume_create_manager' (302b5c40-87c1-4e79-bd8d-fdd3fed69837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-6ad00396-fd84-4bad-8455-9c2590b7b064" returned: 0 in 0.458s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-6ad00396-fd84-4bad-8455-9c2590b7b064" released by "delete_volume" :: held 1.088s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:23 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-14db4a40-5728-475f-af48-45f4930648f0 tempest-CinderUnicodeTest-44022649 None] Created volume successfully. Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Created reservations ['48a3777e-0e86-4089-a7d8-4ffc295322fc', '193f0fa4-7050-4345-8fd3-47c1a062ce29', '7723cc87-4394-4570-8819-3c4797fd8a53', 'c158a05d-2cec-4558-89fb-285faeb63bd5'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:23 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:23 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:23 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.477s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:23 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Deleted volume successfully. Feb 24 11:10:23 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-0d3ebdec-9f5f-4047-b8c0-c3129b250fe9 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-6ad00396-fd84-4bad-8455-9c2590b7b064-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-65665eae-ec28-408f-844b-14961a6aa3de-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-65665eae-ec28-408f-844b-14961a6aa3de-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-65665eae-ec28-408f-844b-14961a6aa3de" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.flows.manager.create_volume [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82627) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Flow 'volume_create_manager' (a5be77f0-9afe-4dfb-97e0-64ac5ab40228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9c24d6-467d-4f0b-b6a3-411a963e5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-65665eae-ec28-408f-844b-14961a6aa3de" acquired by "delete_volume" :: waited 0.055s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efcc7a2-8481-4769-8e3d-8a6b451c3e3a]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9c24d6-467d-4f0b-b6a3-411a963e5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-260756565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76b08be-f509-445a-889b-e306747068b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4734962a7a4bd48f73a06d21d06850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:25Z,use_quota=True,user_id='80387bc28f264a2d86eea47f054a8b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73115f30-431a-4419-96b3-1177bafd58b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73115f30-431a-4419-96b3-1177bafd58b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3d380c-f541-4b95-880e-abc16f4cebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3d380c-f541-4b95-880e-abc16f4cebee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76b08be-f509-445a-889b-e306747068b1', 'volume_name': 'volume-d76b08be-f509-445a-889b-e306747068b1', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833c062f-4325-4364-a00c-8b7e34d1be41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833c062f-4325-4364-a00c-8b7e34d1be41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3abff44-621f-4b85-b544-62213fd42b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:24 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Volume d76b08be-f509-445a-889b-e306747068b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76b08be-f509-445a-889b-e306747068b1', 'volume_size': 1} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-24T10:10:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-260756565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76b08be-f509-445a-889b-e306747068b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4734962a7a4bd48f73a06d21d06850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-24T10:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-24T10:10:25Z,use_quota=True,user_id='80387bc28f264a2d86eea47f054a8b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(143bd9b7-f281-49cf-b12f-ffd33c2b74fa),volume_type_id=143bd9b7-f281-49cf-b12f-ffd33c2b74fa)}" {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Creating volume d76b08be-f509-445a-889b-e306747068b1 {{(pid=82627) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Selected osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 as target Quobyte volume. {{(pid=82627) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 24 11:10:24 devstack cinder-volume[82627]: INFO cinder.volume.drivers.remotefs [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] casted to osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37 Feb 24 11:10:24 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 1073741824 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:24 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de Feb 24 11:10:24 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:24 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 1073741824 Feb 24 11:10:24 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:25 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 1073741824" returned: 0 in 0.545s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:25 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de" returned: 0 in 0.621s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:25 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de Feb 24 11:10:25 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:25 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 Feb 24 11:10:25 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:25 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-65665eae-ec28-408f-844b-14961a6aa3de" returned: 0 in 0.536s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-65665eae-ec28-408f-844b-14961a6aa3de" released by "delete_volume" :: held 1.181s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:25 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1" returned: 0 in 0.534s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'} {{(pid=82627) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3abff44-621f-4b85-b544-62213fd42b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76b08be-f509-445a-889b-e306747068b1', 'volume_size': 1}' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1bf6b4-b9cf-4c09-b5a4-f47d272670dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 24 11:10:25 devstack cinder-volume[82627]: INFO cinder.volume.flows.manager.create_volume [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Volume volume-d76b08be-f509-445a-889b-e306747068b1 (d76b08be-f509-445a-889b-e306747068b1): created successfully Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1bf6b4-b9cf-4c09-b5a4-f47d272670dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82627) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Flow 'volume_create_manager' (a5be77f0-9afe-4dfb-97e0-64ac5ab40228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82627) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 24 11:10:25 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-333eaeea-5d5e-4982-8ae0-60a7f0413a04 tempest-CinderUnicodeTest-44022649 None] Created volume successfully. Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Created reservations ['10980066-c589-4272-bb65-f3de78a3e4d3', '69204603-9ccb-4a5a-ae58-a240ddf83f61', 'da6b9b6d-ed1a-4d71-8592-40e2c4a8f4ab', '8ea283c0-1caf-4518-8ce2-946ba6490e45'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:25 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:25 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:25 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:26 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.486s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:26 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Deleted volume successfully. Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-6279f9f9-9960-4a6a-ad6a-4dfcc4b15090 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-65665eae-ec28-408f-844b-14961a6aa3de-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-409352fd-a8d3-48d9-a1a5-d736aeb6b35d-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-409352fd-a8d3-48d9-a1a5-d736aeb6b35d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "cinder-quobyte-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" acquired by "delete_volume" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fbecbe-5ef8-43d1-8646-a81c7469e2d7]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:26 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d Feb 24 11:10:26 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Creating offline snapshot 0c51c7cc-68a5-42c0-b4f1-6340eb084289 of volume d76b08be-f509-445a-889b-e306747068b1 {{(pid=82627) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[162e5574-af31-4578-b809-ceaa317dcf1d]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:26 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:27 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 Feb 24 11:10:27 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:27 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" returned: 0 in 0.495s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:27 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d Feb 24 11:10:27 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:27 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1" returned: 0 in 0.483s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 1G {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:27 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 1G Feb 24 11:10:27 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:27 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" returned: 0 in 0.413s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-quobyte-409352fd-a8d3-48d9-a1a5-d736aeb6b35d" released by "delete_volume" :: held 0.940s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Created reservations ['0159cb73-3ae5-4eab-ba01-b96750b51c57', 'c0ec7646-8509-4ccd-8dd0-4262c0e7d1ad', 'b88badfc-18bb-467b-b7ae-d54988f82d49', 'd76f934b-0e27-4450-afb8-801a2beca79a'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:27 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:27 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:27 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 1G" returned: 0 in 0.513s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:27 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76b08be-f509-445a-889b-e306747068b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:27 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76b08be-f509-445a-889b-e306747068b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 Feb 24 11:10:27 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:28 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.462s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:28 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:28 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Deleted volume successfully. Feb 24 11:10:28 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-af25f147-0241-4da2-ae2b-cc94c1f88831 tempest-VolumeDependencyTests-1203560447 None] Lock "cinder-409352fd-a8d3-48d9-a1a5-d736aeb6b35d-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:28 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76b08be-f509-445a-889b-e306747068b1 -F qcow2 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289" returned: 0 in 0.515s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:28 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 is being set with open permissions: ugo+rw Feb 24 11:10:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:28 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 Feb 24 11:10:28 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:28 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289" returned: 0 in 0.464s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:28 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:29 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.info Feb 24 11:10:29 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:29 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.info" returned: 0 in 0.418s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:29 devstack cinder-volume[82627]: WARNING cinder.volume.drivers.remotefs [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.info is being set with open permissions: ugo+rw Feb 24 11:10:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.info {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:29 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.info Feb 24 11:10:29 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:29 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.info" returned: 0 in 0.412s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:29 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.875s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:29 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:UPDATE=275,cinder:SELECT=198,cinder:INSERT=70,cinder:DELETE=20 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:10:29 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=202,cinder:UPDATE=288,cinder:INSERT=63,cinder:DELETE=31 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:10:29 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-9f8f9951-4fb9-4bf1-91ff-771b2f9a6f6b tempest-CinderUnicodeTest-44022649 None] Create snapshot completed successfully Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Acquiring lock "cinder-0c51c7cc-68a5-42c0-b4f1-6340eb084289-delete_snapshot" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Lock "cinder-0c51c7cc-68a5-42c0-b4f1-6340eb084289-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Acquiring lock "cinder-quobyte-d76b08be-f509-445a-889b-e306747068b1" by "delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Lock "cinder-quobyte-d76b08be-f509-445a-889b-e306747068b1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Acquiring lock "cinder-quobyte-0c51c7cc-68a5-42c0-b4f1-6340eb084289" by "_delete_snapshot" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Lock "cinder-quobyte-0c51c7cc-68a5-42c0-b4f1-6340eb084289" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Deleting offline snapshot 0c51c7cc-68a5-42c0-b4f1-6340eb084289 of volume d76b08be-f509-445a-889b-e306747068b1 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] snapshot_file for this snap is: volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 {{(pid=82627) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4048225-ee50-4ba8-a581-9feb2006c5ae]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:30 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 Feb 24 11:10:30 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:30 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289" returned: 0 in 0.494s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.remotefs [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d76b08be-f509-445a-889b-e306747068b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82627) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e443b32-78a1-4a85-94e5-1d1ffe122c37]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:30 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:30 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 Feb 24 11:10:30 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:31 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1" returned: 0 in 0.463s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:31 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 Feb 24 11:10:31 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:31 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289" returned: 0 in 0.454s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:31 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:31 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289 Feb 24 11:10:31 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:31 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1.0c51c7cc-68a5-42c0-b4f1-6340eb084289" returned: 0 in 0.405s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Lock "cinder-quobyte-0c51c7cc-68a5-42c0-b4f1-6340eb084289" released by "_delete_snapshot" :: held 1.880s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Lock "cinder-quobyte-d76b08be-f509-445a-889b-e306747068b1" released by "delete_snapshot" :: held 1.894s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Created reservations ['701c8309-a6a2-45b1-8001-7a8d697bb834', '0b6b5ccd-5232-46b3-ba71-fa5893d754f9', '8cd8dda1-fd3d-4e1d-97a8-49115b34ef19', '3f6000d6-79d1-444e-86f2-7bc400e83728'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:32 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Delete snapshot completed successfully. Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-d77b1fbe-676a-4dfe-baf0-45e391140cfa tempest-CinderUnicodeTest-44022649 None] Lock "cinder-0c51c7cc-68a5-42c0-b4f1-6340eb084289-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "cinder-d76b08be-f509-445a-889b-e306747068b1-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Lock "cinder-d76b08be-f509-445a-889b-e306747068b1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "cinder-quobyte-d76b08be-f509-445a-889b-e306747068b1" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Lock "cinder-quobyte-d76b08be-f509-445a-889b-e306747068b1" acquired by "delete_volume" :: waited 0.007s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f96712-b4e3-4aaa-8c89-1f728d61df5f]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:32 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 Feb 24 11:10:32 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:32 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1" returned: 0 in 0.493s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:32 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:32 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1 Feb 24 11:10:32 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:33 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-d76b08be-f509-445a-889b-e306747068b1" returned: 0 in 0.404s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Lock "cinder-quobyte-d76b08be-f509-445a-889b-e306747068b1" released by "delete_volume" :: held 0.935s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Created reservations ['141d73aa-3b52-4fc5-9e66-a11e0e8ff6a3', '7e7e7b29-6cca-4dcf-bb76-acd0f4fd7d15', '9fafc33d-fab0-48c6-b714-4f79a0f587ed', '8365e73e-9a7b-4e0e-8f1f-48ac39674473'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:33 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:33 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "cinder-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a-delete_volume" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Lock "cinder-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "cinder-quobyte-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a" by "delete_volume" {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Lock "cinder-quobyte-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a" acquired by "delete_volume" :: waited 0.010s {{(pid=82627) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f71f67-62d2-4544-8620-4c2c68dbdb98]: (4, 'qcow2') {{(pid=83419) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:33 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a Feb 24 11:10:33 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:33 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.431s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:33 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Deleted volume successfully. Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-4726c5e2-84cb-44ac-8565-ec42919d3359 tempest-CinderUnicodeTest-44022649 None] Lock "cinder-d76b08be-f509-445a-889b-e306747068b1-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:33 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a" returned: 0 in 0.475s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:33 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:33 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a Feb 24 11:10:33 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_service.periodic_task [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:34 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:34 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:34 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761/volume-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a" returned: 0 in 0.416s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Lock "cinder-quobyte-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a" released by "delete_volume" :: held 0.925s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.quota [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Created reservations ['fe2d6e1b-4c44-4b6a-ab6b-d190a545ffb5', '960edc10-df47-4253-a431-cf9808f283d4', '7e7a50f5-a4b8-4fce-833f-02a4fcf12dcb', '4334bfb2-0e8c-44e4-95f6-9c0a29712640'] {{(pid=82627) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37': None} {{(pid=82627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.volume.drivers.quobyte [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ddab4ccd-e2bb-4ae6-940d-cecd04b63c37'] {{(pid=82627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.lockutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 24 11:10:34 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761 Feb 24 11:10:34 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 24 11:10:34 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.465s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-886f2c35-bba3-402c-9fc8-66c19a3988b8 None None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:34 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG oslo_concurrency.processutils [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50d3978d036bdb354d28a6dde9ddd761" returned: 0 in 0.455s {{(pid=82627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.manager [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Notifying Schedulers of capabilities ... {{(pid=82627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 24 11:10:34 devstack cinder-volume[82627]: INFO cinder.volume.manager [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Deleted volume successfully. Feb 24 11:10:34 devstack cinder-volume[82627]: DEBUG cinder.coordination [None req-93ce02ff-d6c4-4244-bd7c-00f8f4278d14 tempest-CinderUnicodeTest-44022649 None] Lock "cinder-1ab3f077-9d6a-46e4-b8e4-05fcd89ea37a-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=82627) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 24 11:10:44 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:DELETE=1,cinder:SELECT=13,cinder:UPDATE=24,cinder:INSERT=3 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 24 11:10:44 devstack cinder-volume[82627]: DEBUG dbcounter [-] [82627] Writing DB stats cinder:SELECT=18,cinder:INSERT=9,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=82627) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}